Techniques of Model Reductions in Biochemical Cell Signaling Pathways. There are many mathematical models of biochemical cell signaling pathways that contain a large number of elements (species and reactions). This is sometimes a big issue for identifying critical model elements and describing the model dynamics. Thus, techniques of model reduction can be used as a mathematical tool in order to minimize the number of variables and parameters. In this thesis, we review some well known methods of model reduction for cell signaling pathways. We have also developed some approaches that provide us a great step forward in model reduction. The techniques are quasi steady state approximation (QSSA), quasi equilibrium approximation (QEA), lumping of species and entropy production analysis. They are applied on protein translation pathways with microRNA mechanisms, chemical reaction networks, extracellular signal regulated kinase (ERK) pathways, NFkB signal transduction pathways, elongation factors EFTu and EFTs signaling pathways and Dihydrofolate reductase (DHFR) pathways. The main aim of this thesis is to reduce the complex cell signaling pathway models. This provides one a better understanding of the dynamics of such models and gives an accurate approximate solution. Results show that there is a good agreement between the original models and the simplified models.


IdentityDP Differential Private Identification Protection for Face Images. Because of the explosive growth of face photos as well as their widespread dissemination and easy accessibility in social media, the security and privacy of personal identity information becomes an unprecedented challenge. Meanwhile, the convenience brought by advanced identity agnostic computer vision technologies is attractive. Therefore, it is important to use face images while taking careful consideration in protecting people's identities. Given a face image, face de identification, also known as face anonymization, refers to generating another image with similar appearance and the same background, while the real identity is hidden. Although extensive efforts have been made, existing face de identification techniques are either insufficient in photo reality or incapable of well balancing privacy and utility. In this paper, we focus on tackling these challenges to improve face de identification. We propose IdentityDP, a face anonymization framework that combines a data driven deep neural network with a differential privacy (DP) mechanism. This framework encompasses three stages facial representations disentanglement, epsilon IdentityDP perturbation and image reconstruction. Our model can effectively obfuscate the identity related information of faces, preserve significant visual similarity, and generate high quality images that can be used for identity agnostic computer vision tasks, such as detection, tracking, etc. Different from the previous methods, we can adjust the balance of privacy and utility through the privacy budget according to pratical demands and provide a diversity of results without pre annotations. Extensive experiments demonstrate the effectiveness and generalization ability of our proposed anonymization framework.


BACON Deep Learning Powered AI for Poetry Generation with Author Linguistic Style Transfer. This paper describes BACON, a basic prototype of an automatic poetry generator with author linguistic style transfer. It combines concepts and techniques from finite state machinery, probabilistic models, artificial neural networks and deep learning, to write original poetry with rich aesthetic qualities in the style of any given author. Extrinsic evaluation of the output generated by BACON shows that participants were unable to tell the difference between human and AI generated poems in any statistically significant way.


Energy Prioritized Caching for Cellular D2D Networks. Multimedia content transmission heavily taxes network resources and puts a significant burden on wireless systems in terms of capacity and energy consumption. In this context, device to device (D2D) paradigm has a utilitarian value to alleviate the network burden by utilizing short range transmissions with less energy cost. For the realization of proper D2D networking, caching in devices is essential. Additionally, caching needs to operate efficiently with the aim of realizing network wide energy improvements. To this end, we study multimedia caching in cellular D2D networks and propose an energy prioritized D2D caching (EPDC) algorithm in this work. We also investigate the optimal caching policy in that system setting. The impact of device capacity and D2D transmission range on energy consumption is studied by focusing on different operation modes such as D2D and base station transmissions. According to the simulation results, EPDC algorithm has substantial energy efficiency gains over the commonly utilized Least Recently Used (LRU) algorithm and content based caching algorithms PDC and SXO. For larger D2D transmission ranges, this improvement becomes more evident.


DGL LifeSci An Open Source Toolkit for Deep Learning on Graphs in Life Science. Graph neural networks (GNNs) constitute a class of deep learning methods for graph data. They have wide applications in chemistry and biology, such as molecular property prediction, reaction prediction and drug target interaction prediction. Despite the interest, GNN based modeling is challenging as it requires graph data pre processing and modeling in addition to programming and deep learning. Here we present DGL LifeSci, an open source package for deep learning on graphs in life science. DGL LifeSci is a python toolkit based on RDKit, PyTorch and Deep Graph Library (DGL). DGL LifeSci allows GNN based modeling on custom datasets for molecular property prediction, reaction prediction and molecule generation. With its command line interfaces, users can perform modeling without any background in programming and deep learning. We test the command line interfaces using standard benchmarks MoleculeNet, USPTO, and ZINC. Compared with previous implementations, DGL LifeSci achieves a speed up by up to 6x. For modeling flexibility, DGL LifeSci provides well optimized modules for various stages of the modeling pipeline. In addition, DGL LifeSci provides pre trained models for reproducing the test experiment results and applying models without training. The code is distributed under an Apache 2.0 License and is freely accessible at https github.com awslabs dgl lifesci.


A Two Step Framework for Arbitrage Free Prediction of the Implied Volatility Surface. We propose a two step framework for predicting the implied volatility surface over time without static arbitrage. In the first step, we select features to represent the surface and predict them over time. In the second step, we use the predicted features to construct the implied volatility surface using a deep neural network (DNN) model by incorporating constraints that prevent static arbitrage. We consider three methods to extract features from the implied volatility data principal component analysis, variational autoencoder and sampling the surface, and we predict these features using LSTM. Using a long time series of implied volatility data for S P500 index options to train our models, we find two feature construction methods, sampling the surface and variational autoencoders combined with DNN for surface construction, are the best performers in out of sample prediction. In particular, they outperform a classical method substantially. Furthermore, the DNN model for surface construction not only removes static arbitrage, but also significantly reduces the prediction error compared with a standard interpolation method. Our framework can also be used to simulate the dynamics of the implied volatility surface without static arbitrage.


VEM and the Mesh. In this work we report some results, obtained within the framework of the ERC Project CHANGE, on the impact on the performance of the virtual element method of the shape of the polygonal elements of the underlying mesh. More in detail, after reviewing the state of the art, we present a) an experimental analysis of the convergence of the VEM under condition violating the standard shape regularity assumptions, b) an analysis of the correlation between some mesh quality metrics and a set of different performance indexes, and c) a suitably designed mesh quality indicator, aimed at predicting the quality of the performance of the VEM on a given mesh.


On the Configurations of Closed Kinematic Chains in three dimensional Space. A kinematic chain in three dimensional Euclidean space consists of n links that are connected by spherical joints. Such a chain is said to be within a closed configuration when its link lengths form a closed polygonal chain in three dimensions. We investigate the space of configurations, described in terms of joint angles of its spherical joints, that satisfy the the loop closure constraint, meaning that the kinematic chain is closed. In special cases, we can find a new set of parameters that describe the diagonal lengths (the distance of the joints from the origin) of the configuration space by a simple domain, namely a cube of dimension n 3 . We expect that the new findings can be applied to various problems such as motion planning for closed kinematic chains or singularity analysis of their configuration spaces. To demonstrate the practical feasibility of the new method, we present numerical examples.


Lowest order equivalent nonstandard finite element methods for biharmonic plates. The popular (piecewise) quadratic schemes for the biharmonic equation based on triangles are the nonconforming Morley finite element, the discontinuous Galerkin, the C 0 interior penalty, and the WOPSIP schemes. Those methods are modified in their right hand side F in H 2 ( Omega) replaced by F circ (JI rm M ) and then are quasi optimal in their respective discrete norms. The smoother JI rm M is defined for a piecewise smooth input function by a (generalized) Morley interpolation I rm M followed by a companion operator J . An abstract framework for the error analysis in the energy, weaker and piecewise Sobolev norms for the schemes is outlined and applied to the biharmonic equation. Three errors are also equivalent in some particular discrete norm from Carstensen, Gallistl, Nataraj Comparison results of nonstandard P 2 finite element methods for the biharmonic problem, ESAIM Math. Model. Numer. Anal. (2015) without data oscillations. This paper extends the work Veeser, Zanotti Quasi optimal nonconforming methods for symmetric elliptic problems, SIAM J. Numer. Anal. 56 (2018) to the discontinuous Galerkin scheme and adds error estimates in weaker and piecewise Sobolev norms.


Inclusive Mentoring The Mindset of an Effective Mentor. This article discusses the mindset of an effective mentor. Guidelines are provided for how to be a good mentor.


Laser Cooling of a Yb Doped Silica Fiber by 18 Kelvin From Room Temperature. A ytterbium doped silica optical fiber has been cooled by 18.4K below ambient temperature by pumping with 20W of 1035nm light in vacuum. In air, cooling by 3.6K below ambient was observed with the same 20W pump. The temperatures were measured with a thermal imaging camera and differential luminescence thermometry. The cooling efficiency is calculated to be 1.2 0.1 . The core of the fiber was codoped with Al3 for an Al to Yb ratio of 6 1, to allow for a larger Yb concentration and enhanced laser cooling.


Stochastic Equidistribution and Generalized Adelic Measures. We study the dynamics of stochastic families of rational maps on the projective line. As such families can be infinite and may not typically be defined over a single number field, we introduce the concept of generalized adelic measures, generalizing previous notions introduced by Favre and Rivera Letelier and Mavraki and Ye. Generalized adelic measures are defined over the measure space of places of an algebraic closure of the rationals, using a framework established by Allcock and Vaaler. This turns our heights from sums over places into integrals. We prove an equidistribution result for generalized adelic measures, and use this result to prove an equidistribution result for random backwards orbits in stochastic arithmetic dynamics.


Design and test of a portable Gamma Ray Burst simulator for GECAM. The main scientific goal of the Gravitational wave high energy Electromagnetic Counterpart All sky Monitor (GECAM) is to monitor various types of Gamma Ray Bursts (GRB) originated from merger of binary compact stars, which could also produce gravitational wave, and collapse of massive stars. In order to study the response of GECAM Gamma Ray Detectors (GRDs) to high energy bursts and test the in flight trigger and localization software of GECAM before the launch, a portable GRB simulator device is designed and implemented based on grid controlled X ray tube (GCXT) and direct digital synthesis (DDS) technologies. The design of this GRB simulator which modulates X ray flux powered by high voltage up to 20 kV is demonstrated, and the time jitter (FWHM) of the device is about 0.9 mu s. Before the launch in December, 2020, both two GECAM satellites were irradiated by different types of GRBs (including short and long bursts in duration) generated by this GRB simulator. The light curves detected with GECAM GRDs are consistent with the programmed input functions within statistical uncertainties, indicating the good performance of both the GRDs and the GRB simulator.


End to End Segmentation based News Summarization. In this paper, we bring a new way of digesting news content by introducing the task of segmenting a news article into multiple sections and generating the corresponding summary to each section. We make two contributions towards this new task. First, we create and make available a dataset, SegNews, consisting of 27k news articles with sections and aligned heading style section summaries. Second, we propose a novel segmentation based language generation model adapted from pre trained language models that can jointly segment a document and produce the summary for each section. Experimental results on SegNews demonstrate that our model can outperform several state of the art sequence to sequence generation models for this new task.


Tree based local explanations of machine learning model predictions, AraucanaXAI. Increasingly complex learning methods such as boosting, bagging and deep learning have made ML models more accurate, but harder to understand and interpret. A tradeoff between performance and intelligibility is often to be faced, especially in high stakes applications like medicine. In the present article we propose a novel methodological approach for generating explanations of the predictions of a generic ML model, given a specific instance for which the prediction has been made, that can tackle both classification and regression tasks. Advantages of the proposed XAI approach include improved fidelity to the original model, the ability to deal with non linear decision boundaries, and native support to both classification and regression problems


Impact of the activation rate of the hyperpolarization activated current I rm h on the neuronal membrane time constant and synaptic potential duration. The temporal dynamics of membrane voltage changes in neurons is controlled by ionic currents. These currents are characterized by two main properties conductance and kinetics. The hyperpolarization activated current ( I rm h ) strongly modulates subthreshold potential changes by shortening the excitatory postsynaptic potentials and decreasing their temporal summation. Whereas the shortening of the synaptic potentials caused by the I rm h conductance is well understood, the role of the I rm h kinetics remains unclear. Here, we use a model of the I rm h current model with either fast or slow kinetics to determine its influence on the membrane time constant ( tau m ) of a CA1 pyramidal cell model. Our simulation results show that the I rm h with fast kinetics decreases tau m and attenuates and shortens the excitatory postsynaptic potentials more than the slow I rm h . We conclude that the I rm h activation kinetics is able to modulate tau m and the temporal properties of excitatory postsynaptic potentials (EPSPs) in CA1 pyramidal cells. In order to elucidate the mechanisms by which I rm h kinetics controls tau m , we propose a new concept called "time scaling factor". Our main finding is that the I rm h kinetics influences tau m by modulating the contribution of the I rm h derivative conductance to tau m .


Continuous Time Higher Order Markov Chains Formulation and Parameter Estimation. Stochastic processes find applications in modelling systems in a variety of disciplines. A large number of stochastic models considered are Markovian in nature. It is often observed that higher order Markov processes can model the data better. However most higher order Markov models are discrete. Here, we propose a novel continuous time formulation of higher order Markov processes, as stochastic differential equations, and propose a method of parameter estimation by maximum likelihood methods.


Longitudinal phase space matching between radio frequency systems with different harmonic numbers and accelerating voltages. We describe a simple mechanism to transform bunches with matched longitudinal phase space distributions from one RF system to a matched distribution of a second RF system operating on a different harmonic and with a different accelerating voltage. The process is reversible and the longitudinal emittance is preserved. Simple equations that characterize the procedure are given and applications are discussed. In particular this method can be used to rapidly shorten the bunch length in proton rings.


Higher Performance Visual Tracking with Dual Modal Localization. Visual Object Tracking (VOT) has synchronous needs for both robustness and accuracy. While most existing works fail to operate simultaneously on both, we investigate in this work the problem of conflicting performance between accuracy and robustness. We first conduct a systematic comparison among existing methods and analyze their restrictions in terms of accuracy and robustness. Specifically, 4 formulations offline classification (OFC), offline regression (OFR), online classification (ONC), and online regression (ONR) are considered, categorized by the existence of online update and the types of supervision signal. To account for the problem, we resort to the idea of ensemble and propose a dual modal framework for target localization, consisting of robust localization suppressing distractors via ONR and the accurate localization attending to the target center precisely via OFC. To yield a final representation (i.e, bounding box), we propose a simple but effective score voting strategy to involve adjacent predictions such that the final representation does not commit to a single location. Operating beyond the real time demand, our proposed method is further validated on 8 datasets VOT2018, VOT2019, OTB2015, NFS, UAV123, LaSOT, TrackingNet, and GOT 10k, achieving state of the art performance.


A Robust Multi Channel EMG System for Lower Back and Abdominal Muscles Training. EMG is an established method to acquire the action potentials of contracted muscles. Although commercial EMG systems are available and it is one of the most researched biosignals, it has never become widely used in rehabilitation or fitness training monitoring. The reasons are technical challenges of wearable EMG systems regarding electrode placement, motion artefacts and the complex connectivity of multi channel EMG measurements. We address this problem for the lower back and abdominal musculature, through a novel dry electrodes belt, multi channel high density EMG circuitry and problem specific signal processing. The subject can easily strap the dry electrodes belt around himself which provides 16 EMG channels. Interferences from the ECG and motion artefacts are reduced by a stationary wavelet decomposition. Afterwards, an inter channel filter is applied to increase the robustness of the signals. Subject measurements during different kinds of typical abdominal and lower back training exercises were performed wearing the novel dry electrodes belt. The results show the possibility of robust EMG measurements from the lower back and abdominal muscles by utilizing the gathered redundancy, appropriately. The additional information obtained via the multi channel EMG circuitry and spatial oversampling can be used to address current problems of EMG applications. It combines the advantages of robustness and the capability of using comfortable dry electrodes. Therefore, the proposed measurement method for acquiring spatial information about the muscle contractions from the lower trunk can be used for rehabilitation or fitness training monitoring.


FloorLevel Net Recognizing Floor Level Lines with Height Attention Guided Multi task Learning. The ability to recognize the position and order of the floor level lines that divide adjacent building floors can benefit many applications, for example, urban augmented reality (AR). This work tackles the problem of locating floor level lines in street view images, using a supervised deep learning approach. Unfortunately, very little data is available for training such a network current street view datasets contain either semantic annotations that lack geometric attributes, or rectified facades without perspective priors. To address this issue, we first compile a new dataset and develop a new data augmentation scheme to synthesize training samples by harassing (i) the rich semantics of existing rectified facades and (ii) perspective priors of buildings in diverse street views. Next, we design FloorLevel Net, a multi task learning network that associates explicit features of building facades and implicit floor level lines, along with a height attention mechanism to help enforce a vertical ordering of floor level lines. The generated segmentations are then passed to a second stage geometry post processing to exploit self constrained geometric priors for plausible and consistent reconstruction of floor level lines. Quantitative and qualitative evaluations conducted on assorted facades in existing datasets and street views from Google demonstrate the effectiveness of our approach. Also, we present context aware image overlay results and show the potentials of our approach in enriching AR related applications.


Energy landscape of the two component Curie Weiss Potts model with three spins. In this paper, we investigate the energy landscape of the two component spin systems, known as the Curie Weiss Potts model, which is a generalization of the Curie Weiss model consisting of q ge3 spins. In the energy landscape of a multi component model, the most important element is the relative strength between the inter component interaction strength and the component wise interaction strength. If the inter component interaction is stronger than the component wise interaction, we can expect all the components to be synchronized in the course of metastable transition. However, if the inter component interaction is relatively weaker, then the components will be desynchronized in the course of metastable transition. For the two component Curie Weiss model, the phase transition from synchronization to desynchronization has been precisely characterized in studies owing to its mean field nature. The purpose of this paper is to extend this result to the Curie Weiss Potts model with three spins. We observe that the nature of the phase transition for the three spin case is entirely different from the two spin case of the Curie Weiss model, and the proof as well as the resulting phase diagram is fundamentally different and exceedingly complicated.


The singularity and cosingularity categories of C BG for groups with cyclic Sylow p subgroups. We construct a differential graded algebra (DGA) modelling certain A infty algebras associated with a finite group G with cyclic Sylow subgroups, namely H BG and H Omega BG wedge p . We use our construction to investigate the singularity and cosingularity categories of these algebras. We give a complete classification of the indecomposables in these categories, and describe the Auslander Reiten quiver. The theory applies to Brauer tree algebras in arbitrary characteristic, and we end with an example in characteristic zero coming from the Hecke algebras of symmetric groups.


TABBIE Pretrained Representations of Tabular Data. Existing work on tabular representation learning jointly models tables and associated text using self supervised objective functions derived from pretrained language models such as BERT. While this joint pretraining improves tasks involving paired tables and text (e.g., answering questions about tables), we show that it underperforms on tasks that operate over tables without any associated text (e.g., populating missing cells). We devise a simple pretraining objective (corrupt cell detection) that learns exclusively from tabular data and reaches the state of the art on a suite of table based prediction tasks. Unlike competing approaches, our model (TABBIE) provides embeddings of all table substructures (cells, rows, and columns), and it also requires far less compute to train. A qualitative analysis of our model's learned cell, column, and row representations shows that it understands complex table semantics and numerical trends.


A Graph VAE and Graph Transformer Approach to Generating Molecular Graphs. We propose a combination of a variational autoencoder and a transformer based model which fully utilises graph convolutional and graph pooling layers to operate directly on graphs. The transformer model implements a novel node encoding layer, replacing the position encoding typically used in transformers, to create a transformer with no position information that operates on graphs, encoding adjacent node properties into the edge generation process. The proposed model builds on graph generative work operating on graphs with edge features, creating a model that offers improved scalability with the number of nodes in a graph. In addition, our model is capable of learning a disentangled, interpretable latent space that represents graph properties through a mapping between latent variables and graph properties. In experiments we chose a benchmark task of molecular generation, given the importance of both generated node and edge features. Using the QM9 dataset we demonstrate that our model performs strongly across the task of generating valid, unique and novel molecules. Finally, we demonstrate that the model is interpretable by generating molecules controlled by molecular properties, and we then analyse and visualise the learned latent representation.


An entropy stable spectral vanishing viscosity for discontinuous Galerkin schemes application to shock capturing and LES models. We present a stable spectral vanishing viscosity for discontinuous Galerkin schemes, with applications to turbulent and supersonic flows. The idea behind the SVV is to spatially filter the dissipative fluxes, such that it concentrates in higher wavenumbers, where the flow is typically under resolved, leaving low wavenumbers dissipation free. Moreover, we derive a stable approximation of the Guermond Popov fluxes with the Bassi Rebay 1 scheme, used to introduce density regularization in shock capturing simulations. This filtering uses a Cholesky decomposition of the fluxes that ensures the entropy stability of the scheme, which also includes a stable approximation of boundary conditions for adiabatic walls. For turbulent flows, we test the method with the three dimensional Taylor Green vortex and show that energy is correctly dissipated, and the scheme is stable when a kinetic energy preserving split form is used in combination with a low dissipation Riemann solver. Finally, we test the shock capturing capabilities of our method with the Shu Osher and the supersonic forward facing step cases, obtaining good results without spurious oscillations even with coarse meshes.


CNF Satisfiability in a Subspace and Related Problems. We introduce the problem of finding a satisfying assignment to a CNF formula that must further belong to a prescribed input subspace. Equivalent formulations of the problem include finding a point outside a union of subspaces (the Union of Subspace Avoidance (USA) problem), and finding a common zero of a system of polynomials over F 2 each of which is a product of affine forms. We focus on the case of k CNF formulas (the k SUB SAT problem). Clearly, it is no easier than k SAT, and might be harder. Indeed, via simple reductions we show NP hardness for k 2 and W 1 hardness parameterized by the co dimension of the subspace. We also prove that the optimization version Max 2 SUB SAT is NP hard to approximate better than the trivial 3 4 ratio even on satisfiable instances. On the algorithmic front, we investigate fast exponential algorithms which give non trivial savings over brute force algorithms. We give a simple branching algorithm with runtime 1.5 r for 2 SUB SAT, where r is the subspace dimension and an O (1.4312) n time algorithm where n is the number of variables. For k more than 2, while known algorithms for solving a system of degree k polynomial equations already imply a solution with runtime 2 r(1 1 2k) , we explore a more combinatorial approach. For instance, based on the notion of critical variables, we give an algorithm with running time n choose le t 2 n n k , where n is the number of variables and t is the co dimension of the subspace. This improves upon the running time of the polynomial equations approach for small co dimension. Our algorithm also achieves polynomial space in contrast to the algebraic approach that uses exponential space.


Central extensions of some linear cycle sets. For each member mathcal A of a family of linear cycle sets whose underlying abelian group is cyclic of order a power of a prime number, we compute all the central extensions of mathcal A by an arbitrary abelian group.


A fourth order compact time splitting method for the Dirac equation with time dependent potentials. In this paper, we present an approach to deal with the dynamics of the Dirac equation with time dependent electromagnetic potentials using the fourth order compact time splitting method ( S text 4c ). To this purpose, the time ordering technique for time dependent Hamiltonians is introduced, so that the influence of the time dependence could be limited to certain steps which are easy to treat. Actually, in the case of the Dirac equation, it turns out that only those steps involving potentials need to be amended, and the scheme remains efficient, accurate, as well as easy to implement. Numerical examples in 1D and 2D are given to validate the scheme.


Evolutionary dynamics on sequential temporal networks. It is well known that population structure is a catalyst for the evolution of cooperation since individuals can reciprocate with their neighbors through local interactions defined by network structures. Previous research typically relies on the assumption that population size is fixed and the structure is time invariant, which is represented by a static network. However, real world populations are often evolving with the successive growth of nodes and links in time, resulting in time varying population structures. Here we model such growing networked populations by sequential temporal networks with an increasing number of nodes and edges and develop the theory of evolutionary dynamics on sequential temporal networks. We derive explicit conditions under which sequential temporal networks promote the evolution of cooperation relative to their static counterparts. In particular, even if natural selection disfavours cooperative behaviours on static networks, sequential temporal networks can surprisingly rescue cooperation. Furthermore, we demonstrate empirically that sequential temporal networks assembled from synthetic and empirical datasets present such promotion in the evolution of cooperation. Our results advance the study of evolutionary dynamics on temporal networks and open the avenue for investigating the evolution of prosocial and other behaviours.


Model calibration using ESEm v1.0.0 an open, scalable Earth System Emulator. Large computer models are ubiquitous in the earth sciences. These models often have tens or hundreds of tuneable parameters and can take thousands of core hours to run to completion while generating terabytes of output. It is becoming common practice to develop emulators as fast approximations, or surrogates, of these models in order to explore the relationships between these inputs and outputs, understand uncertainties and generate large ensembles datasets. While the purpose of these surrogates may differ, their development is often very similar. Here we introduce ESEm an open source tool providing a general workflow for emulating and validating a wide variety of models and outputs. It includes efficient routines for sampling these emulators for the purpose of uncertainty quantification and model calibration. It is built on well established, high performance libraries to ensure robustness, extensibility and scalability. We demonstrate the flexibility of ESEm through three case studies using ESEm to reduce parametric uncertainty in a general circulation model, explore precipitation sensitivity in a cloud resolving model and scenario uncertainty in the CMIP6 multi model ensemble.


Ruta Dis aggregated routing system over multi cloud. Over the years, the SDN evolution create multiple overlay technologies which is inefficient and hard to deploy end to end traffic engineering services, Ruta is designed as an unified encapsulation with Segment Routing, Crypto and NAT Traversal capabilities over UDP. Ruta could be deployed as a cloud native SDN platform globally over multi cloud and integrated with each applications on transport layer, which provide nearly zero loss and almost less than 200ms latency to access anywhere in the world over internet.


Value Gradient based Formulation of Optimal Control Problem and Machine Learning Algorithm. Optimal control problem is typically solved by first finding the value function through Hamilton Jacobi equation (HJE) and then taking the minimizer of the Hamiltonian to obtain the control. In this work, instead of focusing on the value function, we propose a new formulation for the gradient of the value function (value gradient) as a decoupled system of partial differential equations in the context of continuous time deterministic discounted optimal control problem. We develop an efficient iterative scheme for this system of equations in parallel by utilizing the properties that they share the same characteristic curves as the HJE for the value function. For the theoretical part, we prove that this iterative scheme converges linearly in L alpha 2 sense for some suitable exponent alpha in a weight function. For the numerical method, we combine characteristic line method with machine learning techniques. Specifically, we generate multiple characteristic curves at each policy iteration from an ensemble of initial states, and compute both the value function and its gradient simultaneously on each curve as the labelled data. Then supervised machine learning is applied to minimize the weighted squared loss for both the value function and its gradients. Experimental results demonstrate that this new method not only significantly increases the accuracy but also improves the efficiency and robustness of the numerical estimates, particularly with less amount of characteristics data or fewer training steps.


Random sections of ell p ellipsoids, optimal recovery and Gelfand numbers of diagonal operators. We study the circumradius of a random section of an ell p ellipsoid, 0 p le infty , and compare it with the minimal circumradius over all sections with subspaces of the same codimension. Our main result is an upper bound for random sections, which we prove using techniques from asymptotic geometric analysis if 1 leq p leq infty and compressed sensing if 0 p leq 1 . This can be interpreted as a bound on the quality of random (Gaussian) information for the recovery of vectors from an ell p ellipsoid for which the radius of optimal information is given by the Gelfand numbers of a diagonal operator. In the case where the semiaxes decay polynomially and 1 le p le infty , we conjecture that, as the amount of information increases, the radius of random information either decays like the radius of optimal information or is bounded from below by a constant, depending on whether the exponent of decay is larger than the critical value 1 frac 1 p or not. If 1 leq p leq 2 , we prove this conjecture by providing a matching lower bound. This extends the recent work of Hinrichs et al. Random sections of ellipsoids and the power of random information, Trans. Amer. Math. Soc., 2021 for the case p 2 .


Local certification of MSO properties for bounded treedepth graphs. The graph model checking problem consists in testing whether an input graph satisfies a given logical formula. In this paper, we study this problem in a distributed setting, namely local certification. The goal is to assign labels to the nodes of a network to certify that some given property is satisfied, in such a way that the labels can be checked locally. We first investigate which properties can be locally certified with small certificates. Not surprisingly, this is almost never the case, except for not very expressive logic fragments. Following the steps of Courcelle Grohe, we then look for meta theorems explaining what happens when we parameterize the problem by some standard measures of how simple the graph classes are. In that direction, our main result states that any MSO formula can be locally certified on graphs with bounded treedepth with a logarithmic number of bits per node, which is the golden standard in certification.


Data Driven Modeling of S0 S1 Excitation Energy in the BODIPY Chemical Space High Throughput Computation, Quantum Machine Learning, and Inverse Design. Derivatives of BODIPY are popular fluorophores due to their synthetic feasibility, structural rigidity, high quantum yield, and tunable spectroscopic properties. While the characteristic absorption maximum of BODIPY is at 2.5 eV, combinations of functional groups and substitution sites can shift the peak position by 1 eV. Time dependent long range corrected hybrid density functional methods can model the lowest excitation energies offering a semi quantitative precision of 0.3 eV. Alas, the chemical space of BODIPYs stemming from combinatorial introduction of even a few dozen substituents is too large for brute force high throughput modeling. To navigate this vast space, we select 77,412 molecules and train a kernel based quantum machine learning model providing 2 hold out error. Further reuse of the results presented here to navigate the entire BODIPY universe comprising over 253 giga (253 x 10 9) molecules is demonstrated by inverse designing candidates with desired target excitation energies.


Human and Scene Motion Deblurring using Pseudo blur Synthesizer. Present day deep learning based motion deblurring methods utilize the pair of synthetic blur and sharp data to regress any particular framework. This task is designed for directly translating a blurry image input into its restored version as output. The aforementioned approach relies heavily on the quality of the synthetic blurry data, which are only available before the training stage. Handling this issue by providing a large amount of data is expensive for common usage. We answer this challenge by providing an on the fly blurry data augmenter that can be run during training and test stages. To fully utilize it, we incorporate an unorthodox scheme of deblurring framework that employs the sequence of blur deblur reblur deblur steps. The reblur step is assisted by a reblurring module (synthesizer) that provides the reblurred version (pseudo blur) of its sharp or deblurred counterpart. The proposed module is also equipped with hand crafted prior extracted using the state of the art human body statistical model. This prior is employed to map human and non human regions during adversarial learning to fully perceive the characteristics of human articulated and scene motion blurs. By engaging this approach, our deblurring module becomes adaptive and achieves superior outcomes compared to recent state of the art deblurring algorithms.


Approximating Pandora's Box with Correlations. The Pandora's Box problem asks to find a search strategy over n alternatives given stochastic information about their values, aiming to minimize the sum of the search cost and the value of the chosen alternative. Even though the case of independently distributed values is well understood, our algorithmic understanding of the problem is very limited once the independence assumption is dropped. Our work aims to characterize the complexity of approximating the Pandora's Box problem under correlated value distributions. To that end, we present a general reduction to a simpler version of Pandora's Box, that only asks to find a value below a certain threshold, and eliminates the need to reason about future values that will arise during the search. Using this general tool, we study two cases of correlation the case of explicitly given distributions of support m and the case of mixtures of m product distributions. bullet In the first case, we connect Pandora's Box to the well studied problem of Optimal Decision Tree, obtaining an O( log m) approximation but also showing that the problem is strictly easier as it is equivalent (up to constant factors) to the Uniform Decision Tree problem. bullet In the case of mixtures of product distributions, the problem is again related to the noisy variant of Optimal Decision Tree which is significantly more challenging. We give a constant factor approximation that runs in time n tilde O( m 2 varepsilon 2 ) for m mixture components whose marginals on every alternative are either identical or separated in TV distance by varepsilon .


An Essential Local Geometric Morphism which is not Locally Connected though its Inverse Image Part defines an Exponential Ideal. We describe an essential local geometric morphism which is not locally connected, though its inverse image part defines an exponential ideal


Data stream fusion for accurate quantile tracking and analysis. UDDSKETCH is a recent algorithm for accurate tracking of quantiles in data streams, derived from the DDSKETCH algorithm. UDDSKETCH provides accuracy guarantees covering the full range of quantiles independently of the input distribution and greatly improves the accuracy with regard to DDSKETCH. In this paper we show how to compress and fuse data streams (or datasets) by using UDDSKETCH data summaries that are fused into a new summary related to the union of the streams (or datasets) processed by the input summaries whilst preserving both the error and size guarantees provided by UDDSKETCH. This property of sketches, known as mergeability, enables parallel and distributed processing. We prove that UDDSKETCH is fully mergeable and introduce a parallel version of UDDSKETCH suitable for message passing based architectures. We formally prove its correctness and compare it to a parallel version of DDSKETCH, showing through extensive experimental results that our parallel algorithm almost always outperforms the parallel DDSKETCH algorithm with regard to the overall accuracy in determining the quantiles.


Performance of CRC Concatenated Pre transformed RM Polar Codes. In this paper, we discuss pre transformed RM Polar codes and cyclic redundancy check (CRC) concatenated pre transformed RM Polar codes. The simulation results show that the pre transformed RM Polar (256, 128 9) code concatenated with 9 bit CRC can achieve a frame error rate (FER) of 0.001 at Eb No 1.95dB under the list decoding, which is about 0.05dB from the RCU bound. The pre transformed RM Polar (512, 256 9) concatenated with 9 bit CRC can achieve a FER of 0.001 at Eb No 1.6dB under the list decoding, which is 0.15dB from the RCU bound.


Motion Acoustic Flow Field Motion Estimation for Blob Targets in Active Sonar Echograph of Harbor Environments. Motion feature is of great significance for blob targets recognition, behavior analysis and threat estimation in active sonar echographs. Hence, it is desirable to access the space time variation of echo intensity on each spatial temporal resolution cell from the sonar echographs sequence. Then the subtle motion information of the potential blob targets can be accurately characterized. This idea has been conduced in optical image sequences by solving an motion optical flow field (MOFF) function. Nonetheless, due to the sparkle of the sonar echograph sequences, and strong interferences caused by wake and cavitation noise of fast moving ship in harbor environments, the constraints underlying the traditional motion optical flow function that is couples the brightness constancy constant along time dimension of each echo intensity points and the motion field spatial smoothness does not hold in our case. Hence, this paper presents a new motion acoustic flow field (MAFF) function and its solving strategy to accurately characterize the subtle motion information of blob targets in active sonar echographs of harbor environments. Experiments on a series of cooperative targets in real world harbor environments demonstrate the efficacy of our proposed MAFF.


IMU Data Processing For Inertial Aided Navigation A Recurrent Neural Network Based Approach. In this work, we propose a novel method for performing inertial aided navigation, by using deep neural networks (DNNs). To date, most DNN inertial navigation methods focus on the task of inertial odometry, by taking gyroscope and accelerometer readings as input and regressing for integrated IMU poses (i.e., position and orientation). While this design has been successfully applied on a number of applications, it is not of theoretical performance guarantee unless patterned motion is involved. This inevitably leads to significantly reduced accuracy and robustness in certain use cases. To solve this problem, we design a framework to compute observable IMU integration terms using DNNs, followed by the numerical pose integration and sensor fusion to achieve the performance gain. Specifically, we perform detailed analysis on the motion terms in IMU kinematic equations, propose a dedicated network design, loss functions, and training strategies for the IMU data processing, and conduct extensive experiments. The results show that our method is generally applicable and outperforms both traditional and DNN methods by wide margins.


Approximation by Lipschitz functions. On any metric space, I provide an intrinsic characterization of those complex valued functions which are uniform limits of Lipschitz functions. There are applications to function theory on complete Riemannian manifolds and, in particular, on bounded symmetric domains in complex Euclidean space.


Mapping Industry 4.0 Technologies From Cyber Physical Systems to Artificial Intelligence. The fourth industrial revolution is rapidly changing the manufacturing landscape. Due to the growing research and fast evolution in this field, no clear definitions of these concepts yet exist. This work provides a clear description of technological trends and gaps. We introduce a novel method to create a map of Industry 4.0 technologies, using natural language processing to extract technology terms from 14,667 research articles and applying network analysis. We identified eight clusters of Industry 4.0 technologies, which served as the basis for our analysis. Our results show that Industrial Internet of Things (IIoT) technologies have become the center of the Industry 4.0 technology map. This is in line with the initial definitions of Industry 4.0, which centered on IIoT. Given the recent growth in the importance of artificial intelligence (AI), we suggest accounting for AI's fundamental role in Industry 4.0 and understanding the fourth industrial revolution as an AI powered natural collaboration between humans and machines. This article introduces a novel approach for literature reviews, and the results highlight trends and research gaps to guide future work and help these actors reap the benefits of digital transformations.


Asymmetry in earthquake interevent time intervals. Here we focus on a basic statistical measure of earthquake catalogs that has not been studied before, the asymmetry of interevent time series (e.g., reflecting the tendency to have more aftershocks than spontaneous earthquakes). We define the asymmetry metric as the ratio between the number of positive interevent time increments minus negative increments and the total (positive plus negative) number of increments. Such asymmetry commonly exists in time series data for non linear geophysical systems like river flow which decays slowly and increases rapidly. We find that earthquake interevent time series are significantly asymmetric, where the asymmetry function exhibits a significant crossover to weak asymmetry at large lag index. We suggest that the Omori law can be associated with the large asymmetry at short time intervals below the crossover whereas overlapping aftershock sequences and the spontaneous events can be associated with a fast decay of asymmetry above the crossover. We show that the asymmetry is better reproduced by a recently modified ETAS model with two triggering processes in comparison to the standard ETAS model which only has one.


Quasi invariance for infinite dimensional Kolmogorov diffusions. We prove Cameron Martin type quasi invariance results for the heat kernel measure of infinite dimensional Kolmogorov and related diffusions. We first study quantitative functional inequalities for appropriate finite dimensional approximations of these diffusions, and we prove these inequalities hold with dimension independent coefficients. Applying an approach developed by Baudoin, Driver, Gordina, and Melcher previously, these uniform bounds may then be used to prove that the heat kernel measure for certain of these infinite dimensional diffusions is quasi invariant under changes of the initial state.


A profit allocation mechanism for customer to manufacturer platform in e commercial business. A centralized collaboration problem of customer to manufacturer (C2M) platform in e commercial business is studied in this paper, where an e commercial company and multiple manufacturers come to an agreement for constituting a collaborative alliance to satisfy the product orders of multiple customers. The problem has two important issues which are the optimal reallocation of customer orders among the manufacturers to maximize a total profit of the alliance and a fair allocation of the profit among the manufacturers so as to assure the stability of the alliance and the sustainability of C2M platform. A profit allocation mechanism is proposed which is based on core allocation concept and considers the contribution of each manufacturer in fulfilling orders. The effectiveness of the mechanism is evaluated with numerical experiments on sixty instances generated based on real data of Alibaba.


On zeroes and poles of Helson zeta functions. We show that the analytic continuations of Helson zeta functions zeta chi (s) sum 1 infty chi(n)n s can have essentially arbitrary poles and zeroes in the strip 21 40 Re s 1 (unconditionally), and in the whole critical strip 1 2 Re s 1 under Riemann Hypothesis.


Spectral construction of non holomorphic Eisenstein type series and their Kronecker limit formulas. Let X be a smooth, compact, projective K "ahler variety and D be a divisor of a holomorphic form F , and assume that D is smooth up to codimension two. Let omega be a K "ahler form on X and K X the corresponding heat kernel which is associated to the Laplacian that acts on the space of smooth functions on X . Using various integral transforms of K X , we will construct a meromorphic function in a complex variable s whose special value at s 0 is the log norm of F with respect to mu . In the case when X is the quotient of a symmetric space, then the function we construct is a generalization of the so called elliptic Eisenstein series which has been defined and studied for finite volume Riemann surfaces.


Global and local approaches to population analysis bonding patterns in superheavy element compounds. Relativistic effective atomic configurations of superheavy elements Cn, Nh and Fl and their lighter homologues (Hg, Tl and Pb) in their simple compounds with fluorine and oxygen are determined using the analysis of local properties of molecular Kohn Sham density matrices in the vicinity of heavy nuclei. The difference in populations of atomic spinors with the same orbital angular momentum and different total angular momenta is demonstrated to be essential for understanding the peculiarities of chemical bonding in superheavy element compounds. The results are fully compatible with those obtained by the relativistic iterative version of conventional projection analysis of global density matrices.


Independent Policy Gradient Methods for Competitive Reinforcement Learning. We obtain global, non asymptotic convergence guarantees for independent learning algorithms in competitive reinforcement learning settings with two agents (i.e., zero sum stochastic games). We consider an episodic setting where in each episode, each player independently selects a policy and observes only their own actions and rewards, along with the state. We show that if both players run policy gradient methods in tandem, their policies will converge to a min max equilibrium of the game, as long as their learning rates follow a two timescale rule (which is necessary). To the best of our knowledge, this constitutes the first finite sample convergence result for independent policy gradient methods in competitive RL prior work has largely focused on centralized, coordinated procedures for equilibrium computation.


A System for Efficiently Hunting for Cyber Threats in Computer Systems Using Threat Intelligence. Log based cyber threat hunting has emerged as an important solution to counter sophisticated cyber attacks. However, existing approaches require non trivial efforts of manual query construction and have overlooked the rich external knowledge about threat behaviors provided by open source Cyber Threat Intelligence (OSCTI). To bridge the gap, we build ThreatRaptor, a system that facilitates cyber threat hunting in computer systems using OSCTI. Built upon mature system auditing frameworks, ThreatRaptor provides (1) an unsupervised, light weight, and accurate NLP pipeline that extracts structured threat behaviors from unstructured OSCTI text, (2) a concise and expressive domain specific query language, TBQL, to hunt for malicious system activities, (3) a query synthesis mechanism that automatically synthesizes a TBQL query from the extracted threat behaviors, and (4) an efficient query execution engine to search the big system audit logging data.


Stability of Bimodal Planar Switched Linear Systems with Both Stable and Unstable Subsystems. We study dynamics of a bimodal planar linear switched system with a Hurwitz stable and an unstable subsystem. For given textit flee time from the unstable subsystem, the goal is to find corresponding textit dwell time in the Hurwitz stable subsystem so that the switched system is asymptotically stable. The dwell flee relations obtained are in terms of certain smooth functions of the eigenvalues and (generalized) eigenvectors of the subsystem matrices. The results are extended to a special class of symmetric bilinear systems. The results are also extended to a multimodal planar linear switched system in which the switching is governed by an undirected star graph, where the internal node corresponds to a Hurwitz stable (unstable, respectively) subsystem and all the leaves correspond to unstable (Hurwitz stable, respectively) subsystems. For this multimodal system, dwell flee relations are obtained as solutions of a minimax optimization problem.


INRU A Quasigroup Based Lightweight Block Cipher. In this paper, we propose a quasigroup based block cipher design. The round functions of the encryption and decryption algorithms use quasigroup based string transformations. We show the robustness of the design against the standard differential, linear and algebraic cryptanalytic attacks. We also provide detailed statistical analysis using NIST test suite in CBC, CFB, OFB, and CTR modes of operation. We compare the statistical experimental results with the AES 128 in the same setup and conclude that the randomizing ability of our algorithm is equivalent to that of AES 128.


Responsible and Regulatory Conform Machine Learning for Medicine A Survey of Technical Challenges and Solutions. Machine learning is expected to fuel significant improvements in medical care. To ensure that fundamental principles such as beneficence, respect for human autonomy, prevention of harm, justice, privacy, and transparency are respected, medical machine learning applications must be developed responsibly. In this paper, we survey the technical challenges involved in creating medical machine learning systems responsibly and in conformity with existing regulations, as well as possible solutions to address these challenges. We begin by providing a brief overview of existing regulations affecting medical machine learning, showing that properties such as safety, robustness, reliability, privacy, security, transparency, explainability, and nondiscrimination are all demanded already by existing law and regulations albeit, in many cases, to an uncertain degree. Next, we discuss the underlying technical challenges, possible ways for addressing them, and their respective merits and drawbacks. We notice that distribution shift, spurious correlations, model underspecification, and data scarcity represent severe challenges in the medical context (and others) that are very difficult to solve with classical black box deep neural networks. Important measures that may help to address these challenges include the use of large and representative datasets and federated learning as a means to that end, the careful exploitation of domain knowledge wherever feasible, the use of inherently transparent models, comprehensive model testing and verification, as well as stakeholder inclusion.


Joint Superposition Coding and Training for Federated Learning over Multi Width Neural Networks. This paper aims to integrate two synergetic technologies, federated learning (FL) and width adjustable slimmable neural network (SNN) architectures. FL preserves data privacy by exchanging the locally trained models of mobile devices. By adopting SNNs as local models, FL can flexibly cope with the time varying energy capacities of mobile devices. Combining FL and SNNs is however non trivial, particularly under wireless connections with time varying channel conditions. Furthermore, existing multi width SNN training algorithms are sensitive to the data distributions across devices, so are ill suited to FL. Motivated by this, we propose a communication and energy efficient SNN based FL (named SlimFL) that jointly utilizes superposition coding (SC) for global model aggregation and superposition training (ST) for updating local models. By applying SC, SlimFL exchanges the superposition of multiple width configurations that are decoded as many as possible for a given communication throughput. Leveraging ST, SlimFL aligns the forward propagation of different width configurations, while avoiding the inter width interference during backpropagation. We formally prove the convergence of SlimFL. The result reveals that SlimFL is not only communication efficient but also can counteract non IID data distributions and poor channel conditions, which is also corroborated by simulations.


Fighting the curse of dimensionality A machine learning approach to finding global optima. Finding global optima in high dimensional optimization problems is extremely challenging since the number of function evaluations required to sufficiently explore the design space increases exponentially with its dimensionality. Furthermore, non convex cost functions render local gradient based search techniques ineffective. To overcome these difficulties, here we demonstrate the use of machine learning to find global minima, whereby autoencoders are used to drastically reduce the search space dimensionality, and optima are found by surveying the lower dimensional latent spaces. The methodology is tested on benchmark functions and on a structural optimization problem, where we show that by exploiting the behavior of certain cost functions we either obtain the global optimum at best or obtain superior results at worst when compared to established optimization procedures.


Exchange properties of finite set systems. In a recent breakthrough, Adiprasito, Avvakumov, and Karasev constructed a triangulation of the n dimensional real projective space with a subexponential number of vertices. They reduced the problem to finding a small downward closed set system cal F covering an n element ground set which satisfies the following condition For any two disjoint members A, B in cal F , there exist a in A and b in B such that either B cup a in cal F and A cup b setminus a in cal F , or A cup b in cal F and B cup a setminus b in cal F . Denoting by f(n) the smallest cardinality of such a family cal F , they proved that f(n) 2 O( sqrt n log n) , and they asked for a nontrivial lower bound. It turns out that the construction of Adiprasito et al. is not far from optimal we show that 2 (1.42 o(1)) sqrt n le f(n) le 2 (1 o(1)) sqrt 2n log n . We also study a variant of the above problem, where the condition is strengthened by also requiring that for any two disjoint members A, B in cal F with A B , there exists a in A such that B cup a in cal F . In this case, we prove that the size of the smallest cal F satisfying this stronger condition lies between 2 Omega( sqrt n log n) and 2 O(n log log n log n) .


DEMETER Efficient simultaneous curation of genome scale reconstructions guided by experimental data and refined gene annotations. Motivation Manual curation of genome scale reconstructions is laborious, yet existing automated curation tools typically do not take species specific experimental data and manually refined genome annotations into account. Results We developed DEMETER, a COBRA Toolbox extension that enables the efficient simultaneous refinement of thousands of draft genome scale reconstructions while ensuring adherence to the quality standards in the field, agreement with available experimental data, and refinement of pathways based on manually refined genome annotations. Availability DEMETER and tutorials are available at https github.com opencobra cobratoolbox.


Geometric averages of partitioned datasets. We introduce a method for jointly registering ensembles of partitioned datasets in a way which is both geometrically coherent and partition aware. Once such a registration has been defined, one can group partition blocks across datasets in order to extract summary statistics, generalizing the commonly used order statistics for scalar valued data. By modeling a partitioned dataset as an unordered k tuple of points in a Wasserstein space, we are able to draw from techniques in optimal transport. More generally, our method is developed using the formalism of local Fr ' e chet means in symmetric products of metric spaces. We establish basic theory in this general setting, including Alexandrov curvature bounds and a verifiable characterization of local means. Our method is demonstrated on ensembles of political redistricting plans to extract and visualize basic properties of the space of plans for a particular state, using North Carolina as our main example.


Associative Adversarial Learning Based on Selective Attack. A human's attention can intuitively adapt to corrupted areas of an image by recalling a similar uncorrupted image they have previously seen. This observation motivates us to improve the attention of adversarial images by considering their clean counterparts. To accomplish this, we introduce Associative Adversarial Learning (AAL) into adversarial learning to guide a selective attack. We formulate the intrinsic relationship between attention and attack (perturbation) as a coupling optimization problem to improve their interaction. This leads to an attention backtracking algorithm that can effectively enhance the attention's adversarial robustness. Our method is generic and can be used to address a variety of tasks by simply choosing different kernels for the associative attention that select other regions for a specific attack. Experimental results show that the selective attack improves the model's performance. We show that our method improves the recognition accuracy of adversarial training on ImageNet by 8.32 compared with the baseline. It also increases object detection mAP on PascalVOC by 2.02 and recognition accuracy of few shot learning on miniImageNet by 1.63 .


Edge preserving Domain Adaptation for semantic segmentation of Medical Images. Domain Adaptation is a technique to address the lack of massive amounts of labeled data in unseen environments. Unsupervised domain adaptation is proposed to adapt a model to new modalities using solely labeled source data and unlabeled target domain data. Though many image spaces domain adaptation methods have been proposed to capture pixel level domain shift, such techniques may fail to maintain high level semantic information for the segmentation task. For the case of biomedical images, fine details such as blood vessels can be lost during the image transformation operations between domains. In this work, we propose a model that adapts between domains using cycle consistent loss while maintaining edge details of the original images by enforcing an edge based loss during the adaptation process. We demonstrate the effectiveness of our algorithm by comparing it to other approaches on two eye fundus vessels segmentation datasets. We achieve 1.1 to 9.2 increment in DICE score compared to the SOTA and 5.2 increments compared to a vanilla CycleGAN implementation.


BO DBA Query Efficient Decision Based Adversarial Attacks via Bayesian Optimization. Decision based attacks (DBA), wherein attackers perturb inputs to spoof learning algorithms by observing solely the output labels, are a type of severe adversarial attacks against Deep Neural Networks (DNNs) requiring minimal knowledge of attackers. State of the art DBA attacks relying on zeroth order gradient estimation require an excessive number of queries. Recently, Bayesian optimization (BO) has shown promising in reducing the number of queries in score based attacks (SBA), in which attackers need to observe real valued probability scores as outputs. However, extending BO to the setting of DBA is nontrivial because in DBA only output labels instead of real valued scores, as needed by BO, are available to attackers. In this paper, we close this gap by proposing an efficient DBA attack, namely BO DBA. Different from existing approaches, BO DBA generates adversarial examples by searching so called emph directions of perturbations . It then formulates the problem as a BO problem that minimizes the real valued distortion of perturbations. With the optimized perturbation generation process, BO DBA converges much faster than the state of the art DBA techniques. Experimental results on pre trained ImageNet classifiers show that BO DBA converges within 200 queries while the state of the art DBA techniques need over 15,000 queries to achieve the same level of perturbation distortion. BO DBA also shows similar attack success rates even as compared to BO based SBA attacks but with less distortion.


Character sheaves for symmetric pairs spin groups. We determine character sheaves for symmetric pairs associated to spin groups. In particular, we determine the cupsidal character sheaves and show that they can be obtained via the nearby cycle construction of GVX and its generalisation in VX2 .


p robust equilibrated flux reconstruction in boldsymbol H ( mathrm curl ) based on local minimizations. Application to a posteriori analysis of the curl curl problem. We present a local construction of H(curl) conforming piecewise polynomials satisfying a prescribed curl constraint. We start from a piecewise polynomial not contained in the H(curl) space but satisfying a suitable orthogonality property. The procedure employs minimizations in vertex patches and the outcome is, up to a generic constant independent of the underlying polynomial degree, as accurate as the best approximations over the entire local versions of H(curl). This allows to design guaranteed, fully computable, constant free, and polynomial degree robust a posteriori error estimates of Prager Synge type for N 'ed 'elec finite element approximations of the curl curl problem. A divergence free decomposition of a divergence free H(div) conforming piecewise polynomial, relying on over constrained minimizations in Raviart Thomas spaces, is the key ingredient. Numerical results illustrate the theoretical developments.


A Hardware Software Stack for Serverless Edge Swarms. Swarms of autonomous devices are increasing in ubiquity and size, making the need for rethinking their hardware software system stack critical. We present HiveMind, the first swarm coordination platform that enables programmable execution of complex task workflows between cloud and edge resources in a performant and scalable manner. HiveMind is a software hardware platform that includes a domain specific language to simplify programmability of cloud edge applications, a program synthesis tool to automatically explore task placement strategies, a centralized controller that leverages serverless computing to elastically scale cloud resources, and a reconfigurable hardware acceleration fabric for network and remote memory accesses. We design and build the full end to end HiveMind system on two real edge swarms comprised of drones and robotic cars. We quantify the opportunities and challenges serverless introduces to edge applications, as well as the trade offs between centralized and distributed coordination. We show that HiveMind achieves significantly better performance predictability and battery efficiency compared to existing centralized and decentralized platforms, while also incurring lower network traffic. Using both real systems and a validated simulator we show that HiveMind can scale to thousands of edge devices without sacrificing performance or efficiency, demonstrating that centralized platforms can be both scalable and performant.


The fullerenes with a perfect star packing. A spanning subgraph of a graph G is called a perfect star packing in G if every component of the spanning subgraph is isomorphic to the star graph K 1,3 . An efficient dominating set of graph G is a vertex subset D of G such that each vertex of G not in D is adjacent to exactly one vertex from D and any two vertices of D are not adjacent in G . Fullerene graph is a connected plane cubic graph with only pentagonal and hexagonal faces, which is the molecular graph of carbon fullerene. Clearly, a perfect star packing in a fullerene graph G on n vertices will exist if and only if G has an efficient dominating set of cardinality frac n 4 . The problem of finding an efficient dominating set is algorithmically hard cite Alg hard . In this paper, we give a characterization for a fullerene graph to own a perfect star packing. And mainly show that it is necessary for a fullerene G owning a perfect star packing to have order being divisible by 8 . This answers an open problem asked by Dosli ' c et. al. and also shows that a fullerene graph with an efficient dominating set has 8n vertices. By the way, we find some counterexamples for the necessity of Theorem 14 in cite Doslic and list some forbidden configurations to preclude the existence of a perfect star packing of type P0 .


Visible and Near infrared Microdisk Resonators on a 4H Silicon Carbide on Insulator Platform. Wavelength sized microdisk resonators were fabricated on a single crystalline 4H silicon carbide oninsulator platform (4H SiCOI). By carrying out microphotoluminescence measurements at room temperature, we show that the microdisk resonators support whispering gallery modes (WGMs) with quality factors up to 5.25 times 10 3 and mode volumes down to 2.69 times( lambda n) 3 at the visible and near infrared wavelengths. Moreover, the demonstrated wavelength sized microdisk resonators exhibit WGMs whose resonant wavelengths compatible with the zero phonon lines of spin defects in 4H SiCOI, making them a promising candidate for applications in cavity quantum electrodynamics and integrated quantum photonic circuits.


Support Vector Regression Parameters Optimization using Golden Sine Algorithm and its application in stock market. Support vector machine modeling is a new approach in machine learning for classification showing good performance on forecasting problems of small samples and high dimensions. Later, it promoted to Support Vector Regression (SVR) for regression problems. A big challenge for achieving reliable is the choice of appropriate parameters. Here, a novel Golden sine algorithm (GSA) based SVR is proposed for proper selection of the parameters. For comparison, the performance of the proposed algorithm is compared with eleven other meta heuristic algorithms on some historical stock prices of technological companies from Yahoo Finance website based on Mean Squared Error and Mean Absolute Percent Error. The results demonstrate that the given algorithm is efficient for tuning the parameters and is indeed competitive in terms of accuracy and computing time.


DRIBO Robust Deep Reinforcement Learning via Multi View Information Bottleneck. Deep reinforcement learning (DRL) agents are often sensitive to visual changes that were unseen in their training environments. To address this problem, we leverage the sequential nature of RL to learn robust representations that encode only task relevant information from observations based on the unsupervised multi view setting. Specifically, we introduce an auxiliary objective based on the multi view in formation bottleneck (MIB) principle which quantifies the amount of task irrelevant information and encourages learning representations that are both predictive of the future and less sensitive to task irrelevant distractions. This enables us to train high performance policies that are robust to visual distractions and can generalize to unseen environments. We demonstrate that our approach can achieve SOTA performance on diverse visual control tasks on the DeepMind Control Suite, even when the background is replaced with natural videos. In addition, we show that our approach outperforms well established baselines for generalization to unseen environments on the Procgen benchmark. Our code is open sourced and available at https github.com JmfanBU DRIBO.


Effect of Meditation on Heart Rate Variability. The dynamics of the autonomic nervous system, a prime factor for variation of heart rate is modulated by lifestyle factors like meditation and breathing exercises. The effect of meditation (dhyana)practiced by disciples of Ramakrishna Mission(RKM) on the heart rate variability is examined. The heart rate (HR)of a group of disciples of RKM is obtained from ECG signal recorded over a short time duration. Lagged Poincare plot of the heart rate(HR), the method of the principal component analysis, and the autocorrelation of HR fluctuations are used to analyze the HR. The variation of Poincare parameters (SD1),(SD2) and their ratio (SD12), with a lagged number, are non linear and reveal a significant change with meditation. In particular, the magnitude of the slope and the curvature of(SD12) with lagged number increases after meditation. The meditation reduces the heart rate and increases the stroke volume. A strong correlation between slope and curvature of (SD12) is noted from the correlation matrix of multi dimensional data set resulting from the Poincar 'e plot. The principal components (PC) of data resulting from pre and post meditation are well separated in PC space. The entropy associated with R wave fluctuations for all meditators is reduced after meditation. The auto correlation of HR fluctuations exhibits a highly correlated pattern after meditation. The study suggests that meditation improves the heart rate dynamics and the 'calmness' of mind.


Recurrence and transience of random difference equations in the critical case. For i.i.d. random vectors (M 1 ,Q 1 ),(M 2 ,Q 2 ), ldots such that M 0 a.s., Q geq 0 a.s. and mathbb P (Q 0) 1 , the random difference equation X n M n X n 1 Q n , n 1,2, ldots , is studied in the critical case when the random walk with increments log M 1 , log M 2 is oscillating. We provide conditions for the null recurrence and transience of the Markov chain (X n ) n ge 0 by inter alia drawing on techniques developed in the related article Alsmeyer et al (2017) for another case exhibiting the null recurrence transience dichotomy.


Dynamic Attention based Communication Efficient Federated Learning. Federated learning (FL) offers a solution to train a global machine learning model while still maintaining data privacy, without needing access to data stored locally at the clients. However, FL suffers performance degradation when client data distribution is non IID, and a longer training duration to combat this degradation may not necessarily be feasible due to communication limitations. To address this challenge, we propose a new adaptive training algorithm texttt AdaFL , which comprises two components (i) an attention based client selection mechanism for a fairer training scheme among the clients and (ii) a dynamic fraction method to balance the trade off between performance stability and communication efficiency. Experimental results show that our texttt AdaFL algorithm outperforms the usual texttt FedAvg algorithm, and can be incorporated to further improve various state of the art FL algorithms, with respect to three aspects model accuracy, performance stability, and communication efficiency.


GPU accelerated image alignment for object detection in industrial applications. This research proposes a practical method for detecting featureless objects by using image alignment approach with a robust similarity measure in industrial applications. This similarity measure is robust against occlusion, illumination changes and background clutter. The performance of the proposed GPU (Graphics Processing Unit) accelerated algorithm is deemed successful in experiments of comparison between both CPU and GPU implementations


Mutual Information Based Few Shot Classification. We introduce Transductive Infomation Maximization (TIM) for few shot learning. Our method maximizes the mutual information between the query features and their label predictions for a given few shot task, in conjunction with a supervision loss based on the support set. We motivate our transductive loss by deriving a formal relation between the classification accuracy and mutual information maximization. Furthermore, we propose a new alternating direction solver, which substantially speeds up transductive inference over gradient based optimization, while yielding competitive accuracy. We also provide a convergence analysis of our solver based on Zangwill's theory and bound optimization arguments. TIM inference is modular it can be used on top of any base training feature extractor. Following standard transductive few shot settings, our comprehensive experiments demonstrate that TIM outperforms state of the art methods significantly across various datasets and networks, while used on top of a fixed feature extractor trained with simple cross entropy on the base classes, without resorting to complex meta learning schemes. It consistently brings between 2 and 5 improvement in accuracy over the best performing method, not only on all the well established few shot benchmarks but also on more challenging scenarios, with random tasks, domain shift and larger numbers of classes, as in the recently introduced META DATASET. Our code is publicly available at https github.com mboudiaf TIM. We also publicly release a standalone PyTorch implementation of META DATASET, along with additional benchmarking results, at https github.com mboudiaf pytorch meta dataset.


Team PyKale (xy9) Submission to the EPIC Kitchens 2021 Unsupervised Domain Adaptation Challenge for Action Recognition. This report describes the technical details of our submission to the EPIC Kitchens 2021 Unsupervised Domain Adaptation Challenge for Action Recognition. The EPIC Kitchens dataset is more difficult than other video domain adaptation datasets due to multi tasks with more modalities. Firstly, to participate in the challenge, we employ a transformer to capture the spatial information from each modality. Secondly, we employ a temporal attention module to model temporal wise inter dependency. Thirdly, we employ the adversarial domain adaptation network to learn the general features between labeled source and unlabeled target domain. Finally, we incorporate multiple modalities to improve the performance by a three stream network with late fusion. Our network achieves the comparable performance with the state of the art baseline T A 3 N and outperforms the baseline on top 1 accuracy for verb class and top 5 accuracies for all three tasks which are verb, noun and action. Under the team name xy9, our submission achieved 5th place in terms of top 1 accuracy for verb class and all top 5 accuracies.


Real zeros of random trigonometric polynomials with dependent coefficients. We further investigate the relations between the large degree asymptotics of the number of real zeros of random trigonometric polynomials with dependent coefficients and the underlying correlation function. We consider trigonometric polynomials of the form f n(t) frac 1 sqrt n sum k 1 n a k cos(kt) b k sin(kt), x in 0,2 pi , where the sequences (a k) k geq 1 and (b k) k geq 1 are two independent copies of a stationary Gaussian process centered with variance one and correlation function rho with associated spectral measure mu rho . We focus here on the case where mu rho is not purely singular and we denote by psi rho its density component with respect to the Lebesgue measure lambda . Quite surprisingly, we show that the asymptotics of the number of real zeros mathcal N (f n, 0,2 pi ) of f n in 0,2 pi is not related to the decay of the correlation function rho but instead to the Lebesgue measure of the vanishing locus of psi rho . Namely, assuming that psi rho is mathcal C 1 with H "older derivative on an open set of full measure, one establishes that lim n to infty frac mathbb E left mathcal N (f n, 0,2 pi ) right n frac lambda( psi rho 0 ) pi sqrt 2 frac 2 pi lambda( psi rho 0 ) pi sqrt 3 . On the other hand, assuming a sole log integrability condition on psi rho , which implies that it is positive almost everywhere, we recover the asymptotics of the independent case, i.e. the limit is frac 2 sqrt 3 . Besides, with further assumptions of regularity and existence of negative moment for psi rho , we moreover show that the above convergence in expectation can be strengthened to an almost sure convergence.


RMNA A Neighbor Aggregation Based Knowledge Graph Representation Learning Model Using Rule Mining. Although the state of the art traditional representation learning (TRL) models show competitive performance on knowledge graph completion, there is no parameter sharing between the embeddings of entities, and the connections between entities are weak. Therefore, neighbor aggregation based representation learning (NARL) models are proposed, which encode the information in the neighbors of an entity into its embeddings. However, existing NARL models either only utilize one hop neighbors, ignoring the information in multi hop neighbors, or utilize multi hop neighbors by hierarchical neighbor aggregation, destroying the completeness of multi hop neighbors. In this paper, we propose a NARL model named RMNA, which obtains and filters horn rules through a rule mining algorithm, and uses selected horn rules to transform valuable multi hop neighbors into one hop neighbors, therefore, the information in valuable multi hop neighbors can be completely utilized by aggregating these one hop neighbors. In experiments, we compare RMNA with the state of the art TRL models and NARL models. The results show that RMNA has a competitive performance.


Categorizing Items with Short and Noisy Descriptions using Ensembled Transferred Embeddings. Item categorization is a machine learning task which aims at classifying e commerce items, typically represented by textual attributes, to their most suitable category from a predefined set of categories. An accurate item categorization system is essential for improving both the user experience and the operational processes of the company. In this work, we focus on item categorization settings in which the textual attributes representing items are noisy and short, and labels (i.e., accurate classification of items into categories) are not available. In order to cope with such settings, we propose a novel learning framework, Ensembled Transferred Embeddings (ETE), which relies on two key ideas 1) labeling a relatively small sample of the target dataset, in a semi automatic process, and 2) leveraging other datasets from related domains or related tasks that are large scale and labeled, to extract "transferable embeddings". Evaluation of ETE on a large scale real world dataset provided to us by PayPal, shows that it significantly outperforms traditional as well as state of the art item categorization methods.


On the scattering of entropy waves at sudden area expansions. In this work, we investigate both numerically and theoretically the sound generated by entropy waves passing through sudden area expansions. The numerical approach is based on a triple decomposition of the flow variables into a steady mean, a small amplitude coherent part, and a stochastic turbulent part. The mean flow is obtained as the solution of the Reynolds Averaged Navier Stokes (RANS) equations. The equations governing the coherent perturbations are linearised and solved in the frequency domain. To account for the effect of turbulence on the coherent perturbations, a frozen eddy viscosity model is employed. When entropy fluctuations pass through the area expansion, the generated entropy noise behaves as a low pass filter. The numerical predictions of the noise at low frequencies are compared to the predictions of compact, quasi one dimensional, and isentropic theory and large discrepancies are observed. An alternative model for the generated entropy noise tailored for area expansions is then proposed. Such model is based on the conservation of mass, momentum, and energy written in integral form. The model assumes zero frequency and the one dimensionality of the flow variables far upstream and downstream of the expansion. The predictions of this model agree well with the numerical simulations across a range of finite subsonic Mach numbers including low, intermediate, and high Mach numbers.


NodeSRT A Selective Regression Testing Tool for Node.js Application. Node.js is one of the most popular frameworks for building web applications. As software systems mature, the cost of running their entire regression test suite can become significant. Selective Regression Testing (SRT) is a technique that executes only a subset of tests the regression test suite can detect software failures more efficiently. Previous SRT studies mainly focused on standard desktop applications. Node.js applications are considered hard to perform test reduction because of Node's asynchronous, event driven programming model and because JavaScript is a dynamic programming language. In this paper, we present NodeSRT, a Selective Regression Testing framework for Node.js applications. By performing static and dynamic analysis, NodeSRT identifies the relationship between changed methods and tests, then reduces the regression test suite to only tests that are affected by the change to improve the execution time of the regression test suite. To evaluate our selection technique, we applied NodeSRT to two open source projects Uppy and Simorgh, then compared our approach with the retest all strategy and current industry standard SRT technique Jest OnlyChange. The results demonstrate that NodeSRT correctly selects affected tests based on changes and is 250 faster, 450 more precise than the Jest OnlyChange.


Very regular solution to Landau Lifshitz system with spin polarized transport. In this paper, we provide a precise description of the compatibility conditions for the initial data so that one can show the existence and uniqueness of regular short time solution to the Neumann initial boundary problem of a class of Landau Lifshitz Gilbert system with spin polarized transport, which is a strong nonlinear coupled parabolic system with non local energy.


Deep Measurement Updates for Bayes Filters. Measurement update rules for Bayes filters often contain hand crafted heuristics to compute observation probabilities for high dimensional sensor data, like images. In this work, we propose the novel approach Deep Measurement Update (DMU) as a general update rule for a wide range of systems. DMU has a conditional encoder decoder neural network structure to process depth images as raw inputs. Even though the network is trained only on synthetic data, the model shows good performance at evaluation time on real world data. With our proposed training scheme primed data training , we demonstrate how the DMU models can be trained efficiently to be sensitive to condition variables without having to rely on a stochastic information bottleneck. We validate the proposed methods in multiple scenarios of increasing complexity, beginning with the pose estimation of a single object to the joint estimation of the pose and the internal state of an articulated system. Moreover, we provide a benchmark against Articulated Signed Distance Functions(A SDF) on the RBO dataset as a baseline comparison for articulation state estimation.


RethNet Object by Object Learning for Detecting Facial Skin Problems. Semantic segmentation is a hot topic in computer vision where the most challenging tasks of object detection and recognition have been handling by the success of semantic segmentation approaches. We propose a concept of object by object learning technique to detect 11 types of facial skin lesions using semantic segmentation methods. Detecting individual skin lesion in a dense group is a challenging task, because of ambiguities in the appearance of the visual data. We observe that there exist co occurrent visual relations between object classes (e.g., wrinkle and age spot, or papule and whitehead, etc.). In fact, rich contextual information significantly helps to handle the issue. Therefore, we propose REthinker blocks that are composed of the locally constructed convLSTM Conv3D layers and SE module as a one shot attention mechanism whose responsibility is to increase network's sensitivity in the local and global contextual representation that supports to capture ambiguously appeared objects and co occurrence interactions between object classes. Experiments show that our proposed model reached MIoU of 79.46 on the test of a prepared dataset, representing a 15.34 improvement over Deeplab v3 (MIoU of 64.12 ).


On rainbow free colourings of uniform hypergraphs. We study rainbow free colourings of k uniform hypergraphs that is, colourings that use k colours but with the property that no hyperedge attains all colours. We show that p (k 1)( ln n) n is the threshold function for the existence of a rainbow free colouring in a random k uniform hypergraph.


Glacier Calving Front Segmentation Using Attention U Net. An essential climate variable to determine the tidewater glacier status is the location of the calving front position and the separation of seasonal variability from long term trends. Previous studies have proposed deep learning based methods to semi automatically delineate the calving fronts of tidewater glaciers. They used U Net to segment the ice and non ice regions and extracted the calving fronts in a post processing step. In this work, we show a method to segment the glacier calving fronts from SAR images in an end to end fashion using Attention U Net. The main objective is to investigate the attention mechanism in this application. Adding attention modules to the state of the art U Net network lets us analyze the learning process by extracting its attention maps. We use these maps as a tool to search for proper hyperparameters and loss functions in order to generate higher qualitative results. Our proposed attention U Net performs comparably to the standard U Net while providing additional insight into those regions on which the network learned to focus more. In the best case, the attention U Net achieves a 1.5 better Dice score compared to the canonical U Net with a glacier front line prediction certainty of up to 237.12 meters.


Multiplicity and stability of closed characteristics on compact convex P cyclic symmetric hypersurfaces in bf R 2n . Let Sigma be a compact convex hypersurface in bf R 2n which is P cyclic symmetric, i.e., x in Sigma implies Px in Sigma with P being a 2n times2n symplectic orthogonal matrix and satisfying P k I 2n , ker(P l I 2n ) 0 for 1 leq l k , where n, k geq2 . In this paper, we prove that there exist at least n geometrically distinct closed characteristics on Sigma , which solves a longstanding conjecture about the multiplicity of closed characteristics for a broad class of compact convex hypersurfaces with symmetries(cf.,Page 235 of cite Eke1 ). Based on the proof, we further prove that if the number of geometrically distinct closed characteristics on Sigma is finite, then at least 2 frac n 2 of them are non hyperbolic and if the number of geometrically distinct closed characteristics on Sigma is exactly n and k geq3 , then all of them are P cyclic symmetric, where a closed characteristic ( tau, y) on Sigma is called P cyclic symmetric if y( bf R ) Py( bf R ) .


DeepViT Towards Deeper Vision Transformer. Vision transformers (ViTs) have been successfully applied in image classification tasks recently. In this paper, we show that, unlike convolution neural networks (CNNs)that can be improved by stacking more convolutional layers, the performance of ViTs saturate fast when scaled to be deeper. More specifically, we empirically observe that such scaling difficulty is caused by the attention collapse issue as the transformer goes deeper, the attention maps gradually become similar and even much the same after certain layers. In other words, the feature maps tend to be identical in the top layers of deep ViT models. This fact demonstrates that in deeper layers of ViTs, the self attention mechanism fails to learn effective concepts for representation learning and hinders the model from getting expected performance gain. Based on above observation, we propose a simple yet effective method, named Re attention, to re generate the attention maps to increase their diversity at different layers with negligible computation and memory cost. The pro posed method makes it feasible to train deeper ViT models with consistent performance improvements via minor modification to existing ViT models. Notably, when training a deep ViT model with 32 transformer blocks, the Top 1 classification accuracy can be improved by 1.6 on ImageNet. Code is publicly available at https github.com zhoudaquan dvit repo.


Hyper Meta Path Contrastive Learning for Multi Behavior Recommendation. User purchasing prediction with multi behavior information remains a challenging problem for current recommendation systems. Various methods have been proposed to address it via leveraging the advantages of graph neural networks (GNNs) or multi task learning. However, most existing works do not take the complex dependencies among different behaviors of users into consideration. They utilize simple and fixed schemes, like neighborhood information aggregation or mathematical calculation of vectors, to fuse the embeddings of different user behaviors to obtain a unified embedding to represent a user's behavioral patterns which will be used in downstream recommendation tasks. To tackle the challenge, in this paper, we first propose the concept of hyper meta path to construct hyper meta paths or hyper meta graphs to explicitly illustrate the dependencies among different behaviors of a user. How to obtain a unified embedding for a user from hyper meta paths and avoid the previously mentioned limitations simultaneously is critical. Thanks to the recent success of graph contrastive learning, we leverage it to learn embeddings of user behavior patterns adaptively instead of assigning a fixed scheme to understand the dependencies among different behaviors. A new graph contrastive learning based framework is proposed by coupling with hyper meta paths, namely HMG CR, which consistently and significantly outperforms all baselines in extensive comparison experiments.


Complex modes in optical fibers and silicon waveguides. At a fixed frequency, a general wave field in an open optical waveguide is a sum of finite number of guided modes and an integral of radiation modes. Most studies on open lossless dielectric waveguides are concerned with regular guided modes which are confined around the waveguide core, have a real propagation constant, and propagate along the waveguide axis without attenuation. However, there may be guided modes with a complex propagation constant even though the waveguide consists of lossless isotropic dielectric materials, and they are the so called complex modes. The complex modes are proper modes confined around the waveguide core, and are different from the leaky modes which have divergent wave fields in the transverse plane. For waveguides with discontinuities and defects, the complex modes can be excited and must be included in eigenmode expansions. However, existing studies on complex modes in open lossless dielectric waveguides are very limited. In this Letter, we consider circular fibers and silicon waveguides, study the formation mechanism of complex modes, and calculate the dispersion relations for several complex modes in each waveguide. For circular fibers, we also determine the minimum refractive index ratio for the existence of complex modes. Our study fills a gap in optical waveguide theory and provides a basis for realizing potential applications of complex modes.