QoS Aware Placement of Deep Learning Services on the Edge with Multiple Service Implementations. Mobile edge computing pushes computationally intensive services closer to the user to provide reduced delay due to physical proximity. This has led many to consider deploying deep learning models on the edge commonly known as edge intelligence (EI). EI services can have many model implementations that provide different QoS. For instance, one model can perform inference faster than another (thus reducing latency) while achieving less accuracy when evaluated. In this paper, we study joint service placement and model scheduling of EI services with the goal to maximize Quality of Servcice (QoS) for end users where EI services have multiple implementations to serve user requests, each with varying costs and QoS benefits. We cast the problem as an integer linear program and prove that it is NP hard. We then prove the objective is equivalent to maximizing a monotone increasing, submodular set function and thus can be solved greedily while maintaining a (1 1 e) approximation guarantee. We then propose two greedy algorithms one that theoretically guarantees this approximation and another that empirically matches its performance with greater efficiency. Finally, we thoroughly evaluate the proposed algorithm for making placement and scheduling decisions in both synthetic and real world scenarios against the optimal solution and some baselines. In the real world case, we consider real machine learning models using the ImageNet 2012 data set for requests. Our numerical experiments empirically show that our more efficient greedy algorithm is able to approximate the optimal solution with a 0.904 approximation on average, while the next closest baseline achieves a 0.607 approximation on average.


Getting a Grip in Materio Evolution of Membrane Morphology for Soft Robotic Jamming Grippers. The application of granular jamming in soft robotics is a recent and promising new technology offer exciting possibilities for creating higher performance robotic devices. Granular jamming is achieved via the application of a vacuum pressure inside a membrane containing particulate matter, and is particularly interesting from a design perspective, as a myriad of design parameters can potentially be exploited to induce a diverse variety of useful behaviours. To date, the effect of variables such as grain shape and size, as well as membrane material, have been studied as a means of inducing bespoke gripping performance, however the other main contributing factor, membrane morphology, has not been studied due to its particular complexities in both accurate modelling and fabrication. This research presents the first study that optimises membrane morphology for granular jamming grippers, combining multi material 3D printing and an evolutionary algorithm to search through a varied morphology design space in materio. Entire generations are printed in a single run and gripper retention force is tested and used as a fitness measure. Our approach is relatively scalable, circumvents the need for modelling, and guarantees the real world performance of the grippers considered. Results show that membrane morphology is a key determinant of gripper performance. Common high performance designs are seen to optimise all three of the main identified mechanisms by which granular grippers generate grip force, are significantly different from a standard gripper morphology, and generalise well across a range of test objects.


Normal forms for hypersurface singularities. We provide normal forms for singularities of analytic hypersurfaces in ( mathbb C n,0) , using holomorphic vector fields.


Incomplete MaxSAT Approaches for Combinatorial Testing. We present a Satisfiability (SAT) based approach for building Mixed Covering Arrays with Constraints of minimum length, referred to as the Covering Array Number problem. This problem is central in Combinatorial Testing for the detection of system failures. In particular, we show how to apply Maximum Satisfiability (MaxSAT) technology by describing efficient encodings for different classes of complete and incomplete MaxSAT solvers to compute optimal and suboptimal solutions, respectively. Similarly, we show how to solve through MaxSAT technology a closely related problem, the Tuple Number problem, which we extend to incorporate constraints. For this problem, we additionally provide a new MaxSAT based incomplete algorithm. The extensive experimental evaluation we carry out on the available Mixed Covering Arrays with Constraints benchmarks and the comparison with state of the art tools confirm the good performance of our approaches.


Reconsidering the design of planar plasmonic lasers gain, gap layers, and mode competition. Because surface plasmons can be confined below the diffraction limit, metallic lasers that support plasmonic modes can provide miniaturized sources of electromagnetic waves. Such devices often exploit a multilayer design, in which a semiconductor gain layer is placed near a metallic interface with a gap layer in between. However, despite many experimental demonstrations, key considerations for these planar metallic lasers remain understudied, leading to incorrect conclusions about the optimal design. Here, we pursue a detailed experimental and theoretical study of planar metallic lasers to explore the effect of design parameters on the lasing behavior. We print semiconductor nanoplatelets as a gain layer of controllable thickness onto alumina coated silver films with integrated planar Fabry P 'erot cavities. Lasing behavior is then monitored with spectrally and polarization resolved far field imaging. The results are compared with a theoretical waveguide model and a detailed rate equation model, which consider both plasmonic and photonic modes. We show that the nature of the lasing mode is dictated by the gain layer thickness. Moreover, by explicitly treating gain in our waveguide model, we find that, contrary to conventional wisdom, a gap layer with high refractive index is advantageous for plasmonic lasing. Additionally, our rate equation model reveals a regime where plasmonic and photonic modes compete within the same device, raising the possibility of facile, active mode switching. These findings provide guidance for future designs of metallic lasers and could lead to on chip lasers with controlled photonic and plasmonic output, switchable at high speeds.


Formulas for moments of class numbers in arithmetic progressions. In this paper, we obtain explicit formulas for the second moments for Hurwitz class numbers H(4n t 2) with t running through a fixed congruence class modulo 3 .


Partitioned difference families the storm has not yet passed. Two years ago, we alarmed the scientific community about the large number of bad papers in the literature on it zero difference balanced functions , where direct proofs of seemingly new results are presented in an unnecessarily lengthy and convoluted way. Indeed, these results had been proved long before and very easily in terms of difference families. In spite of our report, papers of the same kind continue to proliferate. Regrettably, a further attempt to put the topic in order seems unavoidable. While some authors now follow our recommendation of using the terminology of it partitioned difference families , their methods are still the same and their results are often trivial or even wrong. In this note, we show how a very recent paper of this type can be easily dealt with.


When cardinals determine the power set inner models and H "artig quantifier logic. We make use of some observations on the core model, for example assuming V L E , and that there is no inner model with a Woodin cardinal, and M is an inner model with the same cardinals as V , then V M . We conclude in this latter situation that " x mathcal P ( y ) " is Sigma 1 ( Card ) where Card is a predicate true of just the infinite cardinals. It is known that this implies the validities of second order logic are reducible to V I the set of validities of the H "artig quantifier logic. We draw some further conclusions on the L "owenheim number, ell I of the latter logic that if no L E model has a cardinal strong up to an aleph fixed point, and ell I is less than the least weakly inaccessible delta , then (i) ell I is a limit of measurable cardinals of K (ii) the Weak Covering Lemma holds at delta .


System size dependence of a jam absorption driving strategy to remove traffic jam caused by a sag under the presence of traffic instability. Sag is a road section where a downhill changes into an uphill, and is a highway bottleneck. We consider a system in which all vehicles are connected, and run on a single lane road with a sag. We propose a simple strategy for removing each traffic jam caused by the sag. Our strategy assigns a vehicle upstream of the jam front to perform the jam absorption driving (JAD) running toward the predicted goal, and finally removing the jam. We use a microscopic car following model possessing the traffic instability, an acceleration model against the road gradient of a sag, and an instantaneous fuel consumption model. Our main goal is to elucidate the influence of the system size (the number of vehicles in the system) on our strategy. By increasing the system size from 500 to 10000 vehicles, we have found the following results for the average total travel time per vehicle, and the average total fuel consumption per vehicle. Our strategy can reduce the former with a slightly increasing rate of reduction. Our strategy can reduce the latter with a rate of reduction which decreases and becomes roughly constant. Optimal spatiotemporal scales of JAD for the former and the latter become roughly constant, respectively. Minimizing the former and the latter simultaneously is not possible. Not only vehicular traffic flow, but also the collective dynamics of other self driven particles (such as ships, swarm robots, and pedestrians) lined up in a single column, and passing through a bottleneck can be modeled using our strategy.


Sensitive label free IgG detection using MEMS QCM biosensor with 125 MHz wireless quartz resonator. We present a wireless QCM biosensor fabricated using MEMS technology. The MEMS QCM biosensor contains a 125 MHz AT cut quartz resonator embedded in the microchannel. Because of the compact design, the MEMS QCM biosensor is suitable for mass production and device miniaturization. We performed the IgG detection measurement with different concentrations. The detection limit was l ng mL or less, which is superior to that of the gold standard SPR method. Furthermore, we studied the binding affinity between protein A and IgG by studying the frequency response of the QCM biosensor. It shows good agreement with reported values. Therefore, the presented MEMS QCM biosensor has advantages of compact, low cost, low power consumption, high sensitivity, and reliability.


Talbot photolithography optimization with engineered hybrid metal dielectric mask High contrast and highly uniform Talbot stripes. Conventional projection Talbot lithography usually employs opaque (amplitude) or transparent (phase) masks for creating a periodic array of Fresnel diffraction fringes in the photosensitive substrate. For particular mask design the longitudinal periodicity of Talbot carpet can be avoided producing quasi uniform striped pattern (Talbot stripes). We propose a novel hybrid amplitude phase mask which is engineered for obtaining extremely smooth Talbot stripes and simultaneously high lateral optical contrast and extreme spatial resolution better than a third of laser wavelength. By means of the numerical simulations, we demonstrate the robustness of produced striped diffraction patterns against mask design deviation and light incidence angle variations. The reproducibility of the Talbot stripes is reported also for 1D and 2D metal dielectric projection masks.


Neural networks for Anatomical Therapeutic Chemical (ATC) classification. Motivation Automatic Anatomical Therapeutic Chemical (ATC) classification is a critical and highly competitive area of research in bioinformatics because of its potential for expediting drug develop ment and research. Predicting an unknown compound's therapeutic and chemical characteristics ac cording to how these characteristics affect multiple organs systems makes automatic ATC classifica tion a challenging multi label problem. Results In this work, we propose combining multiple multi label classifiers trained on distinct sets of features, including sets extracted from a Bidirectional Long Short Term Memory Network (BiLSTM). Experiments demonstrate the power of this approach, which is shown to outperform the best methods reported in the literature, including the state of the art developed by the fast.ai research group. Availability All source code developed for this study is available at https github.com LorisNanni. Contact loris.nanni unipd.it


Bio inspired robot perception coupled with robot modeled human perception. My overarching research goal is to provide robots with perceptional abilities that allow interactions with humans in a human like manner. To develop these perceptional abilities, I believe that it is useful to study the principles of the human visual system. I use these principles to develop new computer vision algorithms and validate their effectiveness in intelligent robotic systems. I am enthusiastic about this approach as it offers the dual benefit of uncovering principles inherent in the human visual system, as well as applying these principles to its artificial counterpart. Fig. 1 contains a depiction of my research.


Maximizing the Expected Value of a Lottery Ticket How to Sell and When to Buy. Unusually large prize pools in lotteries like Mega Millions and Powerball attract additional bettors, which increases the likelihood that multiple winners will have to share the pool. Thus, the expected value of a lottery ticket decreases as the probability of collisions (two or more bettors with identical winning tickets) increase. We propose a way to increase the expected value of lottery tickets by minimizing collisions, while preserving the independent generation necessary in a distributed point of sales environment. Our approach involves partitioning the ticket space among different vendors and pairing them off to ensure no collisions among pairs. Our analysis demonstrates that this approach increases the expected value each ticket, without increasing the size of the prize pool. We also analyze when ticket sales have maximal expected value, and show that they provide positive returns when the jackpot is between 775.2 million and 1.67 billion dollars.


OmniDet Surround View Cameras based Multi task Visual Perception Network for Autonomous Driving. Surround View fisheye cameras are commonly deployed in automated driving for 360 deg near field sensing around the vehicle. This work presents a multi task visual perception network on unrectified fisheye images to enable the vehicle to sense its surrounding environment. It consists of six primary tasks necessary for an autonomous driving system depth estimation, visual odometry, semantic segmentation, motion segmentation, object detection, and lens soiling detection. We demonstrate that the jointly trained model performs better than the respective single task versions. Our multi task model has a shared encoder providing a significant computational advantage and has synergized decoders where tasks support each other. We propose a novel camera geometry based adaptation mechanism to encode the fisheye distortion model both at training and inference. This was crucial to enable training on the WoodScape dataset, comprised of data from different parts of the world collected by 12 different cameras mounted on three different cars with different intrinsics and viewpoints. Given that bounding boxes is not a good representation for distorted fisheye images, we also extend object detection to use a polygon with non uniformly sampled vertices. We additionally evaluate our model on standard automotive datasets, namely KITTI and Cityscapes. We obtain the state of the art results on KITTI for depth estimation and pose estimation tasks and competitive performance on the other tasks. We perform extensive ablation studies on various architecture choices and task weighting methodologies. A short video at https youtu.be xbSjZ5OfPes provides qualitative results.


Bracket width of simple Lie algebras. The notion of commutator width of a group, defined as the smallest number of commutators needed to represent each element of the derived group as their product, has been extensively studied over the past decades. In particular, in 1992 Barge and Ghys discovered the first example of a simple group of commutator width greater than one among groups of diffeomorphisms of smooth manifolds. We consider a parallel notion of bracket width of a Lie algebra and present the first examples of simple Lie algebras of bracket width greater than one. They are found among the algebras of polynomial vector fields on smooth affine varieties.


Distilling Wikipedia mathematical knowledge into neural network models. Machine learning applications to symbolic mathematics are becoming increasingly popular, yet there lacks a centralized source of real world symbolic expressions to be used as training data. In contrast, the field of natural language processing leverages resources like Wikipedia that provide enormous amounts of real world textual data. Adopting the philosophy of "mathematics as language," we bridge this gap by introducing a pipeline for distilling mathematical expressions embedded in Wikipedia into symbolic encodings to be used in downstream machine learning tasks. We demonstrate that a textit mathematical textit language textit model trained on this "corpus" of expressions can be used as a prior to improve the performance of neural guided search for the task of symbolic regression.


Inpainting Transformer for Anomaly Detection. Anomaly detection in computer vision is the task of identifying images which deviate from a set of normal images. A common approach is to train deep convolutional autoencoders to inpaint covered parts of an image and compare the output with the original image. By training on anomaly free samples only, the model is assumed to not being able to reconstruct anomalous regions properly. For anomaly detection by inpainting we suggest it to be beneficial to incorporate information from potentially distant regions. In particular we pose anomaly detection as a patch inpainting problem and propose to solve it with a purely self attention based approach discarding convolutions. The proposed Inpainting Transformer (InTra) is trained to inpaint covered patches in a large sequence of image patches, thereby integrating information across large regions of the input image. When training from scratch, in comparison to other methods not using extra training data, InTra achieves results on par with the current state of the art on the MVTec AD dataset for detection and surpassing them on segmentation.


A perspective magnetic bed comprising Gd alloy multi microwires for energy efficient magnetic refrigeration. We have designed a new magnetic bed structure with desirable table like magnetocaloric effect (MCE) by using three kinds of soft ferromagnetic Gd Al Co microwire arrays with different Curie temperatures ( T C ). The T C interval of these three wires is 10 K and the designed new structure named Sample A. This sample shows a smooth table like magnetic entropy change ( Delta S M ) at high applied field change ( mu 0 Delta H 5 T ) ranging from 92 K to 107 K. The maximum entropy change ( Delta S M rm max ) and refrigerant capacity (RC) for Sample A at mu 0 Delta H 5 T are calculated to be 9.42 Jkg 1 K 1 and 676 Jkg 1 . The calculated curves of Delta S M(T) and the corresponding experimental data match well with each other, suggesting that the desirable magnetocaloric properties of the microwire arrays can be designed. Simulation shows that the RC values of the designed systems increase when increasing the interval of T C . The table like MCE and the enhanced heat transfer efficiency due to the enhanced surface areas of the microwires make this newly designed magnetic bed very promising for use in energy efficient magnetic refrigerators.


Language Modelling as a Multi Task Problem. In this paper, we propose to study language modelling as a multi task problem, bringing together three strands of research multi task learning, linguistics, and interpretability. Based on hypotheses derived from linguistic theory, we investigate whether language models adhere to learning principles of multi task learning during training. To showcase the idea, we analyse the generalisation behaviour of language models as they learn the linguistic concept of Negative Polarity Items (NPIs). Our experiments demonstrate that a multi task setting naturally emerges within the objective of the more general task of language modelling.We argue that this insight is valuable for multi task learning, linguistics and interpretability research and can lead to exciting new findings in all three domains.


NetMF Network Embedding Based on Fast and Effective Single Pass Randomized Matrix Factorization. In this work, we propose NetMF , a fast, memory efficient, scalable, and effective network embedding algorithm developed for a single machine with CPU only. NetMF is based on the theoretically grounded embedding method NetMF and leverages the theories from randomized matrix factorization to learn embedding efficiently. We firstly propose a fast randomized eigen decomposition algorithm for the modified Laplacian matrix. Then, sparse sign randomized single pass singular value decomposition (SVD) is utilized to avoid constructing dense matrix and generate promising embedding. To enhance the performance of embedding, we apply spectral propagation in NetMF . Finally, A high performance parallel graph processing stack GBBS is used to achieve memory efficiency. Experiment results show that NetMF can learn a powerful embedding from a network with more than 10 11 edges within 1.5 hours at lower memory cost than state of the art methods. The result on ClueWeb with 0.9 billion vertices and 75 billion edges shows that NetMF saves more than half of the memory and runtime than the state of the art and has better performance. The source code of NetMF will be publicly available after the anonymous peer review.


Modeling of carbon pellets disruption mitigation in an NSTX U plasma. Single carbon pellet disruption mitigation simulations using M3D C1 were conducted in an NSTX U like plasma to support the electromagnetic pellet injection concept (EPI). A carbon ablation model has been implemented in M3D C1 and tested with available data. 2D simulations were conducted in order to estimate the amount of carbon needed to quench the plasma, finding that the content in a 1 , mm radius vitreous carbon pellet ( 3.2x10E20 atoms) would be enough if it is entirely ablated. 3D simulations were performed, scanning over pellet velocity and parallel thermal conductivity, as well as different injection directions and pellet concepts (solid pellets and shell pellets). The sensitivity of the thermal quench and other related quantities to these parameters has been evaluated. A 1 mm radius solid pellet only partially ablates at velocities of 300 m s or higher, thus being unable to fully quench the plasma. To further enhance the ablation, approximations to an array of pellets and the shell pellet concept were also explored. 3D field line stochastization plays an important role in both quenching the center of the plasma and in heat flux losses, thus lowering the amount of carbon needed to mitigate the plasma when compared to the 2D case. This study constitutes an important step forward in predict first' simulations for disruption mitigation in NSTX U and other devices, such as ITER.


Homogenization of Non dilute Suspension of Viscous Fluid with Magnetic Particles. This paper seeks to carry out the rigorous homogenization of a particulate flow consisting of a non dilute suspension of a viscous Newtonian fluid with magnetizable particles. The fluid is assumed to be described by the Stokes flow, while the particles are either paramagnetic or diamagnetic, for which the magnetization field is a linear function of the magnetic field. The coefficients of the corresponding partial differential equations are locally periodic. A one way coupling between the fluid domain and the particles is also assumed. The homogenized or effective response of such a suspension is derived, and the mathematical justification of the obtained asymptotics is carried out. The two scale convergence method is adopted for the latter. As a consequence, the presented result provides a justification for the formal asymptotic analysis of L ' e vy and Sanchez Palencia for particulate steady state Stokes flows.


Evaluating Music Recommendations with Binary Feedback for Multiple Stakeholders. High quality user feedback data is essential to training and evaluating a successful music recommendation system, particularly one that has to balance the needs of multiple stakeholders. Most existing music datasets suffer from noisy feedback and self selection biases inherent in the data collected by music platforms. Using the Piki Music dataset of 500k ratings collected over a two year time period, we evaluate the performance of classic recommendation algorithms on three important stakeholders consumers, well known artists and lesser known artists. We show that a matrix factorization algorithm trained on both likes and dislikes performs significantly better compared to one trained only on likes for all three stakeholders.


Information Theoretic Limits of Integrated Sensing and Communication with Correlated Sensing and Channel States for Vehicular Networks. In connected vehicular networks, it is vital to have vehicular nodes that are capable of sensing about surrounding environments and exchanging messages with each other for automating and coordinating purpose. Towards this end, integrated sensing and communication (ISAC), combining both sensing and communication systems to jointly utilize their resources and to pursue mutual benefits, emerges as a new cost effective solution. In ISAC, the hardware and spectrum co sharing leads to a fundamental tradeoff between sensing and communication performance, which is not well understood except for very simple cases with the same sensing and channel states, and perfect channel state information at the receiver (CSIR). In this paper, a general point to point ISAC model is proposed to account for the scenarios that the sensing state is different from but correlated with the channel state, and the CSIR is not necessarily perfect. For the model considered, the optimal tradeoff is characterized by a capacity distortion function that quantifies the best communication rate for a given sensing distortion constraint requirement. An iterative algorithm is proposed to compute such tradeoff, and a few non trivial examples are constructed to demonstrate the benefits of ISAC as compared to the separation based approach.


The evolution of forecasting for decision making in dynamic environments. Economic and evolutionary theories of strategic behavior make similar predictions in a fixed environment, even though one approach assumes perfect rationality and the other assumes no cognition whatsoever. But predictions differ in a dynamic environment. Here we explore a middle ground between economic rationality and evolutionary myopia. Starting from a population of purely myopic agents, whose actions feed back on the environment to produce cyclical dynamics, we study whether evolution can favor the emergence of new type that forms forecasts about the future environment. We show that forecasting types have an evolutionary advantage, even when they pay a cost to produce forecasts. Forecasting types can invade but not overtake the population, resulting in a stable coexistence with myopic types. Moreover, forecasters provide a public good by reducing the amplitude of environmental oscillations and thereby increasing the mean fitness for forecasting and myopic types alike. We interpret our results as a natural evolution of cognitive styles, and we discuss applications to problems of decision making with environmental feedback in both human and non human systems.


On automorphisms of categories. Let V be a variety of algebras of some type. An interest to describing automorphisms of the category C of finitely generated free V algebras was inspired in connection with development of universal algebraic geometry founded by B. Plotkin. There are a lot of results on this subject. A common method of getting such results was suggested and applied by B. Plotkin and the author (B. Plotkin , G. Zhitomirski, On automorphisms of categories of free algebras of some varieties, J. Algebra 306(2) (2006) 344 367). The method is to find all terms in the language of a given variety which determine such V algebras that are isomorphic to a given C algebra and have the same underlying set with it. But this method can be applied only to automorphisms which take all objects to isomorphic ones. The aim of the present paper is to suggest another method that is free from the mentioned restriction. This method is based on two main theorems. Let C be a category supplied with a faithful representative functor to the category of sets. Theorem 1 gives a general description of automorphisms of C, using a new notion of a quasi inner automorphism. Theorem 5 shows how to obtain the full description of automorphisms of the category of finitely generated free V algebras. The investigation ends with two examples. The first of them shows the preference of our method in a known situation (the variety of all semigroups) and the second one demonstrates obtaining new results (the variety of all modules over arbitrary ring with unit and the consequence for the rings without zero divisors).


Minimization of Stochastic First order Oracle Complexity of Adaptive Methods for Nonconvex Optimization. Numerical evaluations have definitively shown that, for deep learning optimizers such as stochastic gradient descent, momentum, and adaptive methods, the number of steps needed to train a deep neural network halves for each doubling of the batch size and that there is a region of diminishing returns beyond the critical batch size. In this paper, we determine the actual critical batch size by using the global minimizer of the stochastic first order oracle (SFO) complexity of the optimizer. To prove the existence of the actual critical batch size, we set the lower and upper bounds of the SFO complexity and prove that there exist critical batch sizes in the sense of minimizing the lower and upper bounds. This proof implies that, if the SFO complexity fits the lower and upper bounds, then the existence of these critical batch sizes demonstrates the existence of the actual critical batch size. We also discuss the conditions needed for the SFO complexity to fit the lower and upper bounds and provide numerical results that support our theoretical results.


Justifying the Dependability and Security of Business Critical Blockchain based Applications. In the industry, blockchains are increasingly used as the backbone of product and process traceability. Blockchain based traceability participates in the demonstration of product and or process compliance with existing safety standards or quality criteria. In this perspective, services and applications built on top of blockchains are business critical applications, because an intended failure or corruption of the system can lead to an important reputation loss regarding the products or the processes involved. The development of a blockchain based business critical application must be then conducted carefully, requiring a thorough justification of its dependability and security. To this end, this paper encourages an engineering perspective rooted in well understood tools and concepts borrowed from the engineering of safety critical systems. Concretely, we use a justification framework, called CAE (Claim, Argument, Evidence), by following an approach based on assurance cases, in order to provide convincing arguments that a business critical blockchain based application is dependable and secure. The application of this approach is sketched with a case study based on the blockchain HYPERLEDGER FABRIC.


CvS Classification via Segmentation For Small Datasets. Deep learning models have shown promising results in a wide range of computer vision applications across various domains. The success of deep learning methods relies heavily on the availability of a large amount of data. Deep neural networks are prone to overfitting when data is scarce. This problem becomes even more severe for neural network with classification head with access to only a few data points. However, acquiring large scale datasets is very challenging, laborious, or even infeasible in some domains. Hence, developing classifiers that are able to perform well in small data regimes is crucial for applications with limited data. This paper presents CvS, a cost effective classifier for small datasets that derives the classification labels from predicting the segmentation maps. We employ the label propagation method to achieve a fully segmented dataset with only a handful of manually segmented data. We evaluate the effectiveness of our framework on diverse problems showing that CvS is able to achieve much higher classification results compared to previous methods when given only a handful of examples.


Propensity matrix method for age dependent stochastic infectious disease models. Mathematical modeling is one of the key factors of the effective control of newly found infectious diseases, such as COVID 19. Our knowledge about the parameters and the course of the infection is highly limited in the beginning of the epidemic, hence computer implementation of the models have to be quick and flexible. The propensity matrix update graph method we discuss in this paper serves as a convenient approach to efficiently implement age structured stochastic epidemic models. The code base we implemented for our forecasting work is also included in the attached GitHub repository.


On Jacobians of geometrically reduced curves and their N 'eron models. We study the structure of Jacobians of geometrically reduced curves over arbitrary (i. e., not necessarily perfect) fields. We show that, while such a group scheme cannot in general be decomposed into an affine and an Abelian part as over perfect fields, several important structural results for these group schemes nevertheless have close analoga over non perfect fields. We apply our results to prove two conjectures due to Bosch L "utkebohmert Raynaud about the existence of N 'eron models and N 'eron lft models over excellent Dedekind schemes in the special case of Jacobians of geometrically reduced curves. Finally, we prove some existence results for semi factorial models and related objects for general geometrically integral curves in the local case.


A fast direct solver for integral equations on locally refined boundary discretizations and its application to multiphase flow simulations. In transient simulations of particulate Stokes flow, to accurately capture the interaction between the constituent particles and the confining wall, the discretization of the wall often needs to be locally refined in the region approached by the particles. Consequently, standard fast direct solvers lose their efficiency since the linear system changes at each time step. This manuscript presents a new computational approach that avoids this issue by pre constructing a fast direct solver for the wall ahead of time, computing a low rank factorization to capture the changes due to the refinement, and solving the problem on the refined discretization via a Woodbury formula. Numerical results illustrate the efficiency of the solver in accelerating particulate Stokes simulations.


Influence of trapezoidal lobe strut on fuel mixing and combustion in supersonic combustion chamber. The fuel injection system is the main process in supersonic vehicles. In this article, injection of fuel jet through a trapezoidal strut in the coaxial supersonic air stream is investigated. The numerical method is applied for the simulation of three dimensional trapezoidal lobe strut in supersonic flow. Hydrogen gas is injected from the end of the trapezoidal strut injector to augment fuel mixing and diffusion downstream by intensifying vortices inside the domain. The power of the vortices varies by the injector velocity and free stream condition. To simulate our model, RANS equations with the SST turbulence model are solved. Effects of free stream velocity and fuel jet total pressure on fuel distribution and mixing are also investigated. Our results indicate that fuel mixing enhances about 18 when a rectangular strut is replaced by a trapezoidal one. An achieved finding disclosed that the strength of vortices is amplified by the presence of a trapezoidal strut injector.


1D self healing beams in integrated silicon photonics. Since the first experimental observation of optical Airy beams, various applications ranging from particle and cell micromanipulation to laser micromachining have exploited their non diffracting and accelerating properties. The later discovery that Airy beams can self heal after being blocked by an obstacle further proved their robustness to propagate under scattering and disordered environment. Here, we report the generation of Airy beams on an integrated silicon photonic chip and demonstrate that the on chip 1D Airy beams preserve the same properties as the 2D beams. The 1D meta optics used to create the Airy beam has the size of only 3 by 16 microns, at least three orders of magnitude smaller than the conventional optic. The on chip self healing beams demonstrated here could potentially enable diffraction free light routing for on chip optical networks and high precision micromanipulation of bio molecules on an integrated photonic chip.


psc2code Denoising Code Extraction from Programming Screencasts. In this paper, we propose an approach named psc2code to denoise the process of extracting source code from programming screencasts. First, psc2code leverages the Convolutional Neural Network based image classification to remove non code and noisy code frames. Then, psc2code performs edge detection and clustering based image segmentation to detect sub windows in a code frame, and based on the detected sub windows, it identifies and crops the screen region that is most likely to be a code editor. Finally, psc2code calls the API of a professional OCR tool to extract source code from the cropped code regions and leverages the OCRed cross frame information in the programming screencast and the statistical language model of a large corpus of source code to correct errors in the OCRed source code. We conduct an experiment on 1,142 programming screencasts from YouTube. We find that our CNN based image classification technique can effectively remove the non code and noisy code frames, which achieves an F1 score of 0.95 on the valid code frames. Based on the source code denoised by psc2code, we implement two applications 1) a programming screencast search engine 2) an interaction enhanced programming screencast watching tool. Based on the source code extracted from the 1,142 collected programming screencasts, our experiments show that our programming screencast search engine achieves the precision 5, 10, and 20 of 0.93, 0.81, and 0.63, respectively.


Parameter Inference with Bifurcation Diagrams. Estimation of parameters in differential equation models can be achieved by applying learning algorithms to quantitative time series data. However, sometimes it is only possible to measure qualitative changes of a system in response to a controlled condition. In dynamical systems theory, such change points are known as bifurcations and lie on a function of the controlled condition called the bifurcation diagram. In this work, we propose a gradient based approach for inferring the parameters of differential equations that produce a user specified bifurcation diagram. The cost function contains an error term that is minimal when the model bifurcations match the specified targets and a bifurcation measure which has gradients that push optimisers towards bifurcating parameter regimes. The gradients can be computed without the need to differentiate through the operations of the solver that was used to compute the diagram. We demonstrate parameter inference with minimal models which explore the space of saddle node and pitchfork diagrams and the genetic toggle switch from synthetic biology. Furthermore, the cost landscape allows us to organise models in terms of topological and geometric equivalence.


Daugavet points in projective tensor products. In this paper, we are interested in studying when an element z in the projective tensor product X widehat otimes pi Y turns out to be a Daugavet point. We prove first that, under some hypothesis, the assumption of X widehat otimes pi Y having the Daugavet property implies the existence of a great amount of isometries from Y into X . Having this in mind, we provide methods for constructing non trivial Daugavet points in X widehat otimes pi Y . We show that C(K) spaces are examples of Banach spaces such that the set of the Daugavet points in C(K) widehat otimes pi Y is weakly dense when Y is a subspace of C(K) . Finally, we present some natural results on when an elementary tensor x otimes y is a Daugavet point.


Interplay of photons and charge carriers in thin film devices. Thin films are gaining ground in photonics and optoelectronics, promising improvements in their efficiency and functionality as well as decreased material usage as compared to bulk technologies. However, proliferation of thin films would benefit not only from continuous improvements in their fabrication, but also from a unified and accurate theoretical framework of the interplay of photons and charge carriers. In particular, such a framework would need to account quantitatively and self consistently for photon recycling and interference effects. To this end, here we combine the drift diffusion formalism of charge carrier dynamics and the fluctuational electrodynamics of photon transport self consistently using the recently introduced interference extended radiative transfer equations. The resulting equation system can be solved numerically using standard simulation tools, and as an example, here we apply it to study well known GaAs thin film solar cells. In addition to obtaining the expected device characteristics, we analyze the underlying complex photon transport and recombination generation processes, demonstrating the physical insight provided for unevenly excited structures through the direct and self consistent description of photons and charge carriers. The methodology proposed in this work is general and can be used to obtain accurate physical insight into a wide range of planar optoelectronic devices, of which the thin film single junction solar cells studied here are only one example.


Data Lake Ingestion Management. Data Lake (DL) is a Big Data analysis solution which ingests raw data in their native format and allows users to process these data upon usage. Data ingestion is not a simple copy and paste of data, it is a complicated and important phase to ensure that ingested data are findable, accessible, interoperable and reusable at all times. Our solution is threefold. Firstly, we propose a metadata model that includes information about external data sources, data ingestion processes, ingested data, dataset veracity and dataset security. Secondly, we present the algorithms that ensure the ingestion phase (data storage and metadata instanciation). Thirdly, we introduce a developed metadata management system whereby users can easily consult different elements stored in DL.


A priori subcell limiting approach for the FR CPR method on unstructured meshes. A priori subcell limiting approach is developed for high order flux reconstruction correction procedure via reconstruction (FR CPR) on two dimensional unstructured quadrilateral meshes. Firstly, a modified indicator based on modal energy coefficients is proposed to detect troubled cells. Then, troubled cells are decomposed into nonuniform subcells and each subcell has one solution point. A second order finite difference shock capturing scheme based on nonuniform nonlinear weighted (NNW) interpolation is constructed to calculate troubled cells while smooth cells are calculated by the CPR method. Numerical investigations show that the subcell limiting strategy on unstructured quadrilateral meshes is robust in shock capturing.


A Typed Programmatic Interface to Contracts on the Blockchain. Smart contract applications on the blockchain can only reach their full potential if they integrate seamlessly with traditional software systems via a programmatic interface. This interface should provide for originating and invoking contracts as well as observing the state of the blockchain. We propose a typed API for this purpose and establish some properties of the combined system. Specifically, we provide an execution model that enables us to prove type safe interaction between programs and the blockchain. We establish further properties of the model that give rise to requirements on the API. A prototype of the interface is implemented in OCaml for the Tezos blockchain.


An optimal transport approach of hypocoercivity for the 1d kinetic Fokker Plank equation. A quadratic optimal transport metric on the set of probability measure over R 2 is introduced. The quadratic cost is given by the euclidean norm on R 2 associated to some well chosen symmetric positive matrix, which makes the metric equivalent to the usual Wasserstein 2 metric. The dissipation of the distance to the equilibrium along the kinetic Fokker Planck flow, is bounded by below in terms of the distance itself. It enables to obtain some new type of trend to equilibrium estimate in Wasserstein 2 like metric, in the case of non convex confinement potential.


Unity is Strength A Formalization of Cross Domain Maximal Extractable Value. The multi chain future is upon us. Modular architectures are coming to maturity across the ecosystem to scale bandwidth and throughput of cryptocurrency. One example of such is the Ethereum modular architecture, with its beacon chain, its execution chain, its Layer 2s, and soon its shards. These can all be thought as separate blockchains, heavily inter connected with one another, and together forming an ecosystem. In this work, we call each of these interconnected blockchains "domains", and study the manifestation of Maximal Extractable Value (MEV, a generalization of "Miner Extractable Value") across them. In other words, we investigate whether there exists extractable value that depends on the ordering of transactions in two or more domains jointly. We first recall the definitions of Extractable and Maximal Extractable Value, before introducing a definition of Cross Domain Maximal Extractable Value. We find that Cross Domain MEV can be used to measure the incentive for transaction sequencers in different domains to collude with one another, and study the scenarios in which there exists such an incentive. We end the work with a list of negative externalities that might arise from cross domain MEV extraction and lay out several open questions. We note that the formalism in this work is a work in progress, and we hope that it can serve as the basis for formal analysis tools in the style of those presented in Clockwork Finance, as well as for discussion on how to mitigate the upcoming negative externalities of substantial cross domain MEV.


Action Set Based Policy Optimization for Safe Power Grid Management. Maintaining the stability of the modern power grid is becoming increasingly difficult due to fluctuating power consumption, unstable power supply coming from renewable energies, and unpredictable accidents such as man made and natural disasters. As the operation on the power grid must consider its impact on future stability, reinforcement learning (RL) has been employed to provide sequential decision making in power grid management. However, existing methods have not considered the environmental constraints. As a result, the learned policy has risk of selecting actions that violate the constraints in emergencies, which will escalate the issue of overloaded power lines and lead to large scale blackouts. In this work, we propose a novel method for this problem, which builds on top of the search based planning algorithm. At the planning stage, the search space is limited to the action set produced by the policy. The selected action strictly follows the constraints by testing its outcome with the simulation function provided by the system. At the learning stage, to address the problem that gradients cannot be propagated to the policy, we introduce Evolutionary Strategies (ES) with black box policy optimization to improve the policy directly, maximizing the returns of the long run. In NeurIPS 2020 Learning to Run Power Network (L2RPN) competition, our solution safely managed the power grid and ranked first in both tracks.


Estimating the Roles of Protonation and Electronic Polarization in Absolute Binding Affinity Simulations. Accurate prediction of binding free energies is critical to streamlining the drug development and protein design process. With the advent of GPU acceleration, absolute alchemical methods, which simulate the removal of ligand electrostatics and van der Waals interactions with the protein, have become routinely accessible and provide a physically rigorous approach that enables full consideration of flexibility and solvent interaction. However, standard explicit solvent simulations are unable to model protonation or electronic polarization changes upon ligand transfer from water to the protein interior, leading to inaccurate prediction of binding affinities for charged molecules. Here, we perform extensive simulation totaling 540 mu s to benchmark the impact of modeling conditions on predictive accuracy for absolute alchemical simulations. Binding to urokinase plasminogen activator (UPA), a protein frequently overexpressed in metastatic tumors, is evaluated for a set of ten inhibitors with extended flexibility, highly charged character, and titratable properties. We demonstrate that the alchemical simulations can be adapted to utilize the MBAR PBSA method to improve the accuracy upon incorporating electronic polarization, highlighting the importance of polarization in alchemical simulations of binding affinities. Comparison of binding energy prediction at various protonation states indicates that proper electrostatic setup is also crucial in binding affinity prediction of charged systems, prompting us to propose an alternative binding mode with protonated ligand phenol and Hid 46 at the binding site, a testable hypothesis for future experimental validation.


Multi Atlas Based Pathological Stratification of d TGA Congenital Heart Disease. One of the main sources of error in multi atlas segmentation propagation approaches comes from the use of atlas databases that are morphologically dissimilar to the target image. In this work, we exploit the segmentation errors associated with poor atlas selection to build a computer aided diagnosis (CAD) system for pathological classification in post operative dextro transposition of the great arteries (d TGA). The proposed approach extracts a set of features, which describe the quality of a segmentation, and introduces them into a logical decision tree that provides the final diagnosis. We have validated our method on a set of 60 whole heart MR images containing healthy cases and two different forms of post operative d TGA. The reported overall CAD system accuracy was of 93.33 .


Unified Pre training for Program Understanding and Generation. Code summarization and generation empower conversion between programming language (PL) and natural language (NL), while code translation avails the migration of legacy code from one PL to another. This paper introduces PLBART, a sequence to sequence model capable of performing a broad spectrum of program and language understanding and generation tasks. PLBART is pre trained on an extensive collection of Java and Python functions and associated NL text via denoising autoencoding. Experiments on code summarization in the English language, code generation, and code translation in seven programming languages show that PLBART outperforms or rivals state of the art models. Moreover, experiments on discriminative tasks, e.g., program repair, clone detection, and vulnerable code detection, demonstrate PLBART's effectiveness in program understanding. Furthermore, analysis reveals that PLBART learns program syntax, style (e.g., identifier naming convention), logical flow (e.g., if block inside an else block is equivalent to else if block) that are crucial to program semantics and thus excels even with limited annotations.


p adic Directions of Primitive Vectors. Linnik type problems concern the distribution of projections of integral points on the unit sphere as their norm increases, and different generalizations of this phenomenon. Our work addresses a question of this type we prove the uniform distribution of the projections of primitive mathbb Z 2 points in the p adic unit sphere, as their (real) norm tends to infinity. The proof is via counting lattice points in semi simple S arithmetic groups.


Anderson Acceleration as a Krylov Method with Application to Asymptotic Convergence Analysis. Anderson acceleration is widely used for accelerating the convergence of fixed point methods x k 1 q(x k ) , x k in mathbb R n . We consider the case of linear fixed point methods x k 1 M x k b and obtain polynomial residual update formulas for AA( m ), i.e., Anderson acceleration with window size m . We find that the standard AA( m ) method with initial iterates x k , k 0, ldots, m defined recursively using AA( k ), is a Krylov space method. This immediately implies that k iterations of AA( m ) cannot produce a smaller residual than k iterations of GMRES without restart (but without implying anything about the relative convergence speed of (windowed) AA( m ) versus restarted GMRES( m )). We introduce the notion of multi Krylov method and show that AA( m ) with general initial iterates x 0, ldots, x m is a multi Krylov method. We find that the AA( m ) residual polynomials observe a periodic memory effect where increasing powers of the error iteration matrix M act on the initial residual as the iteration number increases. We derive several further results based on these polynomial residual update formulas, including orthogonality relations, a lower bound on the AA(1) acceleration coefficient beta k , and explicit nonlinear recursions for the AA(1) residuals and residual polynomials that do not include the acceleration coefficient beta k . We apply these results to study the influence of the initial guess on the asymptotic convergence factor of AA(1).


Integral operators on lattices. As an abstraction and generalization of the integral operator in analysis, integral operators (known as Rota Baxter operators of weight zero) on associative algebras and Lie algebras have played an important role in mathematics and physics. This paper initiates the study of integral operators on lattices and the resulting Rota Baxter lattices (of weight zero). We show that properties of lattices can be characterized in terms of their integral operators. We also display a large number of integral operators on any given lattice and classify the isomorphism classes of integral operators on some common classes of lattices. We further investigate structures on semirings derived from differential and integral operators on lattices.


Relax and fix heuristics applied to a real world lot sizing and scheduling problem in the personal care consumer goods industry. This paper addresses an integrated lot sizing and scheduling problem in the industry of consumer goods for personal care, a very competitive market in which the good customer service level and the cost management show up in the competition for the clients. In this research, a complex operational environment composed of unrelated parallel machines with limited production capacity and sequence dependent setup times and costs is studied. There is also a limited finished goods storage capacity, a characteristic not found in the literature. Backordering is allowed but it is extremely undesirable. The problem is described through a mixed integer linear programming formulation. Since the problem is NP hard, relax and fix heuristics with hybrid partitioning strategies are investigated. Computational experiments with randomly generated and also with real world instances are presented. The results show the efficacy and efficiency of the proposed approaches. Compared to current solutions used by the company, the best proposed strategies yield results with substantially lower costs, primarily from the reduction in inventory levels and better allocation of production batches on the machines.


Binary Signed Digit Integers, the Stern Diatomic Sequence and Stern Polynomials. Stern's diatomic sequence is a well studied and simply defined sequence with many fascinating characteristics. The binary signed digit (BSD) representation of integers is used widely in efficient computation, coding theory and other applications. We link these two objects, showing that the number of i bit binary signed digit representations of an integer n 2 i is the (2 i n) text th element in Stern's diatomic sequence. This correspondence makes the vast range of results known about the Stern diatomic sequence available for consideration in the study of binary signed digit integers, and vice versa. Applications of this relationship discussed in this paper include a weight distribution theorem for BSD representations, linking these representations to Stern polynomials, a recursion for the number of optimal BSD representations of an integer along with their Hamming weight, stemming from an easy recursion for the leading coefficients and degrees of Stern polynomials, and the identification of all integers having a maximal number of such representations.


Joint Active and Passive Beamforming for Intelligent Reflecting Surface Aided Multiuser MIMO Communications. This letter investigates the joint active and passive beamforming optimization for intelligent reflecting surface (IRS) aided multiuser multiple input multiple output systems with the objective of maximizing the weighted sum rate. We show that this problem can be solved via a matrix weighted mean square error minimization equivalence. In particular, for the optimization of the passive IRS beamforming, we first propose an iterative algorithm with excellent performance based on the manifold optimization. By using the matrix fractional programming technique to obtain a more tractable object function, we then propose a low complexity algorithm based on the majorization minimization method. Numerical results verify the convergence of our proposed algorithms and the significant performance improvement over the communication scenario without IRS assistance.


FLEX Unifying Evaluation for Few Shot NLP. Few shot NLP research is highly active, yet conducted in disjoint research threads with evaluation suites that lack challenging yet realistic testing setups and fail to employ careful experimental design. Consequently, the community does not know which techniques perform best or even if they outperform simple baselines. In response, we formulate the FLEX Principles, a set of requirements and best practices for unified, rigorous, valid, and cost sensitive few shot NLP evaluation. These principles include Sample Size Design, a novel approach to benchmark design that optimizes statistical accuracy and precision while keeping evaluation costs manageable. Following the principles, we release the FLEX benchmark, which includes four few shot transfer settings, zero shot evaluation, and a public leaderboard that covers diverse NLP tasks. In addition, we present UniFew, a prompt based model for few shot learning that unifies pretraining and finetuning prompt formats, eschewing complex machinery of recent prompt based approaches in adapting downstream task formats to language model pretraining objectives. We demonstrate that despite simplicity, UniFew achieves results competitive with both popular meta learning and prompt based approaches.


MLFC From 10 to 50 Planners in the Multi Agent Programming Contest. In this paper, we describe the strategies used by our team, MLFC, that led us to achieve the 2nd place in the 15th edition of the Multi Agent Programming Contest. The scenario used in the contest is an extension of the previous edition (14th) "Agents Assemble" wherein two teams of agents move around a 2D grid and compete to assemble complex block structures. We discuss the languages and tools used during the development of our team. Then, we summarise the main strategies that were carried over from our previous participation in the 14th edition and list the limitations (if any) of using these strategies in the latest contest edition. We also developed new strategies that were made specifically for the extended scenario cartography (determining the size of the map) formal verification of the map merging protocol (to provide assurances that it works when increasing the number of agents) plan cache (efficiently scaling the number of planners) task achievement (forming groups of agents to achieve tasks) and bullies (agents that focus on stopping agents from the opposing team). Finally, we give a brief overview of our performance in the contest and discuss what we believe were our shortcomings.


Stability and Generalization of Bilevel Programming in Hyperparameter Optimization. The (gradient based) bilevel programming framework is widely used in hyperparameter optimization and has achieved excellent performance empirically. Previous theoretical work mainly focuses on its optimization properties, while leaving the analysis on generalization largely open. This paper attempts to address the issue by presenting an expectation bound w.r.t. the validation set based on uniform stability. Our results can explain some mysterious behaviours of the bilevel programming in practice, for instance, overfitting to the validation set. We also present an expectation bound for the classical cross validation algorithm. Our results suggest that gradient based algorithms can be better than cross validation under certain conditions in a theoretical perspective. Furthermore, we prove that regularization terms in both the outer and inner levels can relieve the overfitting problem in gradient based algorithms. In experiments on feature learning and data reweighting for noisy labels, we corroborate our theoretical findings.


Conjugacy of Integral Matrices over Algebraic Extensions. We consider conjugacy of integral matrices by elements in text GL n (R) for certain rings R with subring mathbb Z . We note that a Hasse principal does not hold in the context of matrix conjugacy because matrices which are text GL n ( mathbb Z p) conjugate for all p are not necessarily text GL n ( mathbb Z ) conjugate. By a theorem of Guralnick, we know that integral n times n matrices are text GL n ( mathbb Z p) conjugate for all primes p if and only if they are conjugate by an element in text GL n (E) for some algebraic integral extension E of mathbb Z . We study the problem of finding this extension E . Since a result by Latimer and MacDuffee for describing mathbb Z conjugacy can be generalized to the context of R conjugacy for R any integral domain, we can adapt an existing algorithm for mathbb Z conjugacy to a new context. We also offer a method for finding E which makes use of the principal ideal theorems of class field theory. We illustrate our method in several examples.


HoroPCA Hyperbolic Dimensionality Reduction via Horospherical Projections. This paper studies Principal Component Analysis (PCA) for data lying in hyperbolic spaces. Given directions, PCA relies on (1) a parameterization of subspaces spanned by these directions, (2) a method of projection onto subspaces that preserves information in these directions, and (3) an objective to optimize, namely the variance explained by projections. We generalize each of these concepts to the hyperbolic space and propose HoroPCA, a method for hyperbolic dimensionality reduction. By focusing on the core problem of extracting principal directions, HoroPCA theoretically better preserves information in the original data such as distances, compared to previous generalizations of PCA. Empirically, we validate that HoroPCA outperforms existing dimensionality reduction methods, significantly reducing error in distance preservation. As a data whitening method, it improves downstream classification by up to 3.9 compared to methods that don't use whitening. Finally, we show that HoroPCA can be used to visualize hyperbolic data in two dimensions.


Deep Neural Networks to Recover Unknown Physical Parameters from Oscillating Time Series. Deep neural networks (DNNs) are widely used in pattern recognition tasks for which a human comprehensible, quantitative description of the data generating process, e.g., in the form of equations, cannot be achieved. While doing so, DNNs often produce an abstract (entangled and non interpretable) representation of the data generating process. This is one of the reasons why DNNs are not extensively used in physics signal processing physicists generally require their analyses to yield quantitative information about the studied systems. In this article we use DNNs to disentangle components of oscillating time series, and recover meaningful information. We show that, because DNNs can find useful abstract feature representations, they can be used when prior knowledge about the signal generating process exists, but is not complete, as it is particularly the case in "new physics" searches. To this aim, we train our DNN on synthetic oscillating time series to perform two tasks a regression of the signal latent parameters and signal denoising by an Autoencoder like architecture. We show that the regression and denoising performance is similar to those of least square curve fittings (LS fit) with true latent parameters' initial guesses, in spite of the DNN needing no initial guesses at all. We then explore applications in which we believe our architecture could prove useful for time series processing in physics, when prior knowledge is incomplete. As an example, we employ DNNs as a tool to inform LS fits when initial guesses are unknown. We show that the regression can be performed on some latent parameters, while ignoring the existence of others. Because the Autoencoder needs no prior information about the physical model, the remaining unknown latent parameters can still be captured, thus making use of partial prior knowledge, while leaving space for data exploration and discoveries.


The HIBEAM NNBAR Calorimeter Prototype. The HIBEAM NNBAR experiment is a free neutron search for n rightarrow sterile n and n rightarrow bar n oscillations planned to be installed at the European Spallation Source under construction in Lund, Sweden. A key component in the experiment is the detector to identify n bar n annihilation events, which will produce on average four pions with a final state invariant mass of two nucleons, around 1.9 , GeV. The beamline and experiment are shielded from magnetic fields which would suppress n rightarrow bar n transitions, thus no momentum measurement will be possible. Additionally, calorimetry for particles with kinetic energies below 600 , MeV is challenging, as traditional sampling calorimeters used in HEP would suffer from poor shower statistics. A design study is underway to use a novel approach of a hadronic range measurement in multiple plastic scintillator layers, followed by EM calorimetery with lead glass. A prototype calorimeter system is being built, and will eventually be installed at an ESS test beam line for textit in situ neutron background studies.


Transitivity in nonautonomous systems. Let (X,d) be a metric space and f 1, infty f n i 0 infty be a sequence of continuous maps f n X rightarrow X such that (f n) converges uniformly to a continuous map f . We investigate which conditions ensure that the transitivity of functions f n or the transitivity of the nonautonomous system (X,f 1, infty ) is inherited to the limit function f and vice versa. Such problem have been studied for instance by A. Fedeli, A. Le Donne or J. Li who give different sufficient condition for inheriting of transitivity from f n to f . In this paper we give a survey of know result relating to this problem and prove new results concerning to transitivity.


Adaptive Regularized Zero Forcing Precoding for Massive MIMO Systems with Multi Antenna Users. Modern wireless cellular networks use massive multiple input multiple output (MIMO) technology. This technology involves operations with an antenna array at a base station that simultaneously serves multiple mobile devices which also use multiple antennas on their side. For this, various precoding and detection techniques are used, allowing each user to receive the signal intended for him from the base station. There is an important class of linear precoding called Regularized Zero Forcing (RZF). In this work, we propose Adaptive RZF (ARZF) with a special kind of regularization matrix with different coefficients for each layer of multi antenna users. These regularization coefficients are defined by explicit formulas based on SVD decompositions of user channel matrices. We study the optimization problem, which is solved by the proposed algorithm, with the connection to other possible problem statements. We also compare the proposed algorithm with state of the art linear precoding algorithms on simulations with the Quadriga channel model. The proposed approach provides a significant increase in quality with the same computation time as in the reference methods.


Product Progression a machine learning approach to forecasting industrial upgrading. Economic complexity methods, and in particular relatedness measures, lack a systematic evaluation and comparison framework. We argue that out of sample forecast exercises should play this role, and we compare various machine learning models to set the prediction benchmark. We find that the key object to forecast is the activation of new products, and that tree based algorithms clearly overperform both the quite strong auto correlation benchmark and the other supervised algorithms. Interestingly, we find that the best results are obtained in a cross validation setting, when data about the predicted country was excluded from the training set. Our approach has direct policy implications, providing a quantitative and scientifically tested measure of the feasibility of introducing a new product in a given country.


The geometry of electromagnetic curves on Riemannian manifolds. We present a concise definition of an electromagnetic curve on a Riemannian manifold and illustrate the explicit case of the motion of a charged particle on the unit sphere under the influence of a uniform magnetic field.


Deep Q Learning based Reinforcement Learning Approach for Network Intrusion Detection. The rise of the new generation of cyber threats demands more sophisticated and intelligent cyber defense solutions equipped with autonomous agents capable of learning to make decisions without the knowledge of human experts. Several reinforcement learning methods (e.g., Markov) for automated network intrusion tasks have been proposed in recent years. In this paper, we introduce a new generation of network intrusion detection methods that combines a Q learning based reinforcement learning with a deep feed forward neural network method for network intrusion detection. Our proposed Deep Q Learning (DQL) model provides an ongoing auto learning capability for a network environment that can detect different types of network intrusions using an automated trial error approach and continuously enhance its detection capabilities. We provide the details of fine tuning different hyperparameters involved in the DQL model for more effective self learning. According to our extensive experimental results based on the NSL KDD dataset, we confirm that the lower discount factor which is set as 0.001 under 250 episodes of training yields the best performance results. Our experimental results also show that our proposed DQL is highly effective in detecting different intrusion classes and outperforms other similar machine learning approaches.


MLFW A Database for Face Recognition on Masked Faces. As more and more people begin to wear masks due to current COVID 19 pandemic, existing face recognition systems may encounter severe performance degradation when recognizing masked faces. To figure out the impact of masks on face recognition model, we build a simple but effective tool to generate masked faces from unmasked faces automatically, and construct a new database called Masked LFW (MLFW) based on Cross Age LFW (CALFW) database. The mask on the masked face generated by our method has good visual consistency with the original face. Moreover, we collect various mask templates, covering most of the common styles appeared in the daily life, to achieve diverse generation effects. Considering realistic scenarios, we design three kinds of combinations of face pairs. The recognition accuracy of SOTA models declines 5 16 on MLFW database compared with the accuracy on the original images. MLFW database can be viewed and downloaded at url http whdeng.cn mlfw .


Another Riemann Hypothesis Equivalent. Identities involving Mobius function values (u(j),u(k)) are used to generate a Riemann Hypothesis equivalent.


FAST Dynamic Vision Detection and Tracking Dynamic Objects with Event and Depth Sensing. The development of aerial autonomy has enabled aerial robots to fly agilely in complex environments. However, dodging fast moving objects in flight remains a challenge, limiting the further application of unmanned aerial vehicles (UAVs). The bottleneck of solving this problem is the accurate perception of rapid dynamic objects. Recently, event cameras have shown great potential in solving this problem. This paper presents a complete perception system including ego motion compensation, object detection, and trajectory prediction for fast moving dynamic objects with low latency and high precision. Firstly, we propose an accurate ego motion compensation algorithm by considering both rotational and translational motion for more robust object detection. Then, for dynamic object detection, an event camera based efficient regression algorithm is designed. Finally, we propose an optimizationbased approach that asynchronously fuses event and depth cameras for trajectory prediction. Extensive real world experiments and benchmarks are performed to validate our framework. Moreover, our code will be released to benefit related researches.


The downside of heterogeneity How established relations counteract systemic adaptivity in tasks assignments. We study the lock in effect in a network of task assignments. Agents have a heterogeneous fitness for solving tasks and can redistribute unfinished tasks to other agents. They learn over time to whom to reassign tasks and preferably choose agents with higher fitness. A lock in occurs if reassignments can no longer adapt. Agents overwhelmed with tasks then fail, leading to failure cascades. We find that the probability for lock ins and systemic failures increase with the heterogeneity in fitness values. To study this dependence, we use the Shannon entropy of the network of task assignments. A detailed discussion links our findings to the problem of resilience and observations in social systems.


Generating Interesting Song to Song Segues With Dave. We introduce a novel domain independent algorithm for generating interesting item to item textual connections, or segues. Pivotal to our contribution is the introduction of a scoring function for segues, based on their "interestingness". We provide an implementation of our algorithm in the music domain. We refer to our implementation as Dave. Dave is able to generate 1553 different types of segues, that can be broadly categorized as either informative or funny. We evaluate Dave by comparing it against a curated source of song to song segues, called The Chain. In the case of informative segues, we find that Dave can produce segues of the same quality, if not better, than those to be found in The Chain. And, we report positive correlation between the values produced by our scoring function and human perceptions of segue quality. The results highlight the validity of our method, and open future directions in the application of segues to recommender systems research.


An electric vehicle charging station access equilibrium model with M D C queueing. Despite the dependency of electric vehicle (EV) fleets on charging station availability, charging infrastructure remains limited in many cities. Three contributions are made. First, we propose an EV to charging station user equilibrium (UE) assignment model with a M D C queue approximation as a nondifferentiable nonlinear program. Second, to address the non differentiability of the queue delay function, we propose an original solution algorithm based on the derivative free Method of Successive Averages. Computational tests with a toy network show that the model converges to a UE. A working code in Python is provided free on Github with detailed test cases. Third, the model is applied to the large scale case study of New York City Department of Citywide Administrative Services (NYC DCAS) fleet and EV charging station configuration as of July 8, 2020, which includes unique, real data for 563 Level 2 chargers and 4 Direct Current Fast Chargers (DCFCs) and 1484 EVs distributed over 512 Traffic Analysis Zones. The arrival rates of the assignment model are calibrated in the base scenario to fit an observed average utilization ratio of 7.6 in NYC. The model is then applied to compare charging station investment policies of DCFCs to Level 2 charging stations based on two alternative criteria. Results suggest a policy based on selecting locations with high utilization ratio instead of with high queue delay.


Invariant measures for a stochastic nonlinear and damped 2D Schr "odinger equation. We consider a stochastic nonlinear defocusing Schr " o dinger equation with zero order linear damping, where the stochastic forcing term is given by a combination of a linear multiplicative noise in the Stratonovich form and a nonlinear noise in the It o form. We work at the same time on compact Riemannian manifolds without boundary and on relatively compact smooth domains with either the Dirichlet or the Neumann boundary conditions, always in dimension 2. We construct a martingale solution using a modified Faedo Galerkin's method, following arXiv 1707.05610. Then by means of the Strichartz estimates deduced from arXiv math 0609455 but modified for our stochastic setting we show the pathwise uniqueness of solutions. Finally, we prove the existence of an invariant measure by means of a version of the Krylov Bogoliubov method, which involves the weak topology, as proposed by Maslowski and Seidler. This is the first result of this type for stochastic NLS on compact Riemannian manifolds without boundary and on relatively compact smooth domains even for an additive noise. Some remarks on the uniqueness in a particular case are provided as well.


Zipf Matrix Factorization Matrix Factorization with Matthew Effect Reduction. Recommender system recommends interesting items to users based on users' past information history. Researchers have been paying attention to improvement of algorithmic performance such as MAE and precision K. Major techniques such as matrix factorization and learning to rank are optimized based on such evaluation metrics. However, the intrinsic Matthew Effect problem poses great threat to the fairness of the recommender system, and the unfairness problem cannot be resolved by optimization of traditional metrics. In this paper, we propose a novel algorithm that incorporates Matthew Effect reduction with the matrix factorization framework. We demonstrate that our approach can boost the fairness of the algorithm and enhances performance evaluated by traditional metrics.


A perspective of twisted photonic structures. Moire superlattices twisted van der Waals (vdW) structures with small angles are attracting increasing attention in condensed matter physics, due to important phenomena revealed therein, including unconventional superconductivity, correlated insulating states, and ferromagnetism. Moire superlattices are typically comprised of atomic layers of vdW materials where the exotic physics arises from the quantum electronic coupling between adjacent atomic layers. Recently, moire electronics has motivated their photonic counterparts. In addition to vdW materials, twisted photonic systems can also be comprised of metamaterials, metasurfaces, and photonic crystals, mediated by interlayer electromagnetic coupling instead. The interplay between short ranged interlayer quantum and long ranged electromagnetic coupling in twisted structures are expected to yield rich phenomena in nano optics. This perspective reviews recent progress in twisted structures for nanophotonics and outlooks emerging topics, opportunities, fundamental challenges, and potential applications.


D2D Aided Multi Antenna Multicasting under Generalized CSIT. Multicasting, where a base station (BS) wishes to convey the same message to several user equipments (UEs), represents a common yet highly challenging wireless scenario. In fact, guaranteeing decodability by the whole UE population proves to be a major performance bottleneck since the UEs in poor channel conditions ultimately determine the achievable rate. To overcome this issue, two phase cooperative multicasting schemes, which use conventional multicasting in a first phase and leverage device to device (D2D) communications in a second phase to effectively spread the message, have been extensively studied. However, most works are limited either to the simple case of single antenna BS or to a specific channel state information at the transmitter (CSIT) setup. This paper proposes a general two phase framework that is applicable to the cases of perfect, statistical, and topological CSIT in the presence of multiple antennas at the BS. The proposed method exploits the precoding capabilities at the BS, which enable targeting specific UEs that can effectively serve as D2D relays towards the remaining UEs, and maximize the multicast rate under some outage constraint. Numerical results show that our schemes bring substantial gains over traditional single phase multicasting and overcome the worst UE bottleneck behavior in all the considered CSIT configurations.


Abduction of trap invariants in parameterized systems. In a previous paper we have presented a CEGAR approach for the verification of parameterized systems with an arbitrary number of processes organized in an array or a ring. The technique is based on the iterative computation of parameterized invariants, i.e., infinite families of invariants for the infinitely many instances of the system. Safety properties are proved by checking that every global configuration of the system satisfying all parameterized invariants also satisfies the property we have shown that this check can be reduced to the satisfiability problem for Monadic Second Order on words, which is decidable. A strong limitation of the approach is that processes can only have a fixed number of variables with a fixed finite range. In particular, they cannot use variables with range 0,N 1 , where N is the number of processes, which appear in many standard distributed algorithms. In this paper, we extend our technique to this case. While conducting the check whether a safety property is inductive assuming a computed set of invariants becomes undecidable, we show how to reduce it to checking satisfiability of a first order formula. We report on experiments showing that automatic first order theorem provers can still perform this check for a collection of non trivial examples. Additionally, we can give small sets of readable invariants for these checks.


Fast computation of scattered fields with arbitrary beam scattering. Electromagnetic scattering on a sphere is one of the most fundamental problems, which has a closed form analytical solution in the form of Mie series. Being initially formulated for a plane incident wave, the formalism can be extended to more complex forms of incident illumination. Here we present a fast calculation approach to address the scattering problem in the case of arbitrary illumination, incident on a spherical scatterer. This method is based on the plane wave decomposition of the incident illumination and weighted integration of Mie solutions, rotated to a global coordinate system. Tabulated solutions, sampled with an accurately level of sparsity, and efficient rotational transformations allow performing fast calculations on electrically large structures, outperforming capabilities relatively to other numerical techniques. Our approach is suitable for real time analysis of electromagnetic scattering from electrically large objects, which is essential for monitoring and control applications, such as optomechanical manipulation, scanning microscope, and fast optimization algorithms.


MMPTRACK Large scale Densely Annotated Multi camera Multiple People Tracking Benchmark. Multi camera tracking systems are gaining popularity in applications that demand high quality tracking results, such as frictionless checkout because monocular multi object tracking (MOT) systems often fail in cluttered and crowded environments due to occlusion. Multiple highly overlapped cameras can significantly alleviate the problem by recovering partial 3D information. However, the cost of creating a high quality multi camera tracking dataset with diverse camera settings and backgrounds has limited the dataset scale in this domain. In this paper, we provide a large scale densely labeled multi camera tracking dataset in five different environments with the help of an auto annotation system. The system uses overlapped and calibrated depth and RGB cameras to build a high performance 3D tracker that automatically generates the 3D tracking results. The 3D tracking results are projected to each RGB camera view using camera parameters to create 2D tracking results. Then, we manually check and correct the 3D tracking results to ensure the label quality, which is much cheaper than fully manual annotation. We have conducted extensive experiments using two real time multi camera trackers and a person re identification (ReID) model with different settings. This dataset provides a more reliable benchmark of multi camera, multi object tracking systems in cluttered and crowded environments. Also, our results demonstrate that adapting the trackers and ReID models on this dataset significantly improves their performance. Our dataset will be publicly released upon the acceptance of this work.


Clustering based method for finding spikes in insect neurons. Spikes can be easily detected inmostintracellular recordings as sharp peaks. However, insome experimental preparations,because of unipolar morphology or other characteristicsof the recorded neurons, the sizes of the spikes recorded from the soma can be much smaller. The experimental settings and the quality of the recording can also affect the observed amplitudes of the spikes. Whole cell patch clamp recordings from the somata of projection neurons of the antennal lobe in Drosophila or mosquitoes can show spikes with amplitudes as small as 2 mV. Moreover, the observed spikes often ride on relatively large depolarizations, which makes it difficult for the standard thresholding based approaches to distinguish them from noise or sharp EPSPs present in the signal. For spike detection in such neuronal recordings, we propose a clustering based algorithm that separates peaks corresponding to action potentials from those corresponding to noise. Candidate peaks, including many noise peaks, are first selected according to their sharpness, and then a feature vector is extracted for each peak. The 3 dimensional feature vector contains the absolute value of the peak voltage, height of the spike, and the magnitude of the second derivative minima attained during the spike. In most recordings, this 3D space reveals two natural clusters, separating the noise peaks from the true action potentials. Some parameters of the algorithm can be optionally altered by the user to improve detection, which comes handy in the few recordings where the default parameters do not work well. In summary, the algorithm facilitates accurate spike detection to enable the interpretation and analysis of patch clamp data from neuronal recordings in invertebrates. The algorithm is implemented as an freely available open source tool.


Segmenting Hybrid Trajectories using Latent ODEs. Smooth dynamics interrupted by discontinuities are known as hybrid systems and arise commonly in nature. Latent ODEs allow for powerful representation of irregularly sampled time series but are not designed to capture trajectories arising from hybrid systems. Here, we propose the Latent Segmented ODE (LatSegODE), which uses Latent ODEs to perform reconstruction and changepoint detection within hybrid trajectories featuring jump discontinuities and switching dynamical modes. Where it is possible to train a Latent ODE on the smooth dynamical flows between discontinuities, we apply the pruned exact linear time (PELT) algorithm to detect changepoints where latent dynamics restart, thereby maximizing the joint probability of a piece wise continuous latent dynamical representation. We propose usage of the marginal likelihood as a score function for PELT, circumventing the need for model complexity based penalization. The LatSegODE outperforms baselines in reconstructive and segmentation tasks including synthetic data sets of sine waves, Lotka Volterra dynamics, and UCI Character Trajectories.


A multiplicity theorem for anisotropic Robin equations. In this paper we consider an anisotropic Robin problem driven by the p(x) Laplacian and a superlinear reaction. Applying variational tools along with truncation and comparison techniques as well as critical groups, we prove that the problem has at least five nontrivial smooth solutions to be ordered and with sign information two positive, two negative and the fifth nodal.


A Coherent Light Shift on Alkaline Earth Rydberg Atoms from Isolated Core Excitation without Auto Ionization. New experimental quantum simulation platforms have recently been implemented with divalent atoms trapped in optical tweezer arrays with promising performance. The second valence electron also brings new propects through the so called Isolated Core Excitation (ICE), however autoionization presents a strong limitation to this use. In this study, we propose and demonstrate a new approach to applying a sizable light shift to a Rydberg state with close to resonant ICE while avoiding auto ionization. In particular, we have investigated ICE of ytterbium atoms in 1S 0 Rydberg states. Spectroscopic studies of the induced auto ionization and the light shift imparted to the Rydberg states are perfectly accounted for with Multi channel Quantum Defect Theory. Such a control over the inner electron without disturbing the Rydberg electron brings a new tool for the targeted, coherent manipulation of Rydberg states in quantum simulation experiments performed with alkaline earth atoms.


A deep learning model for gas storage optimization. To the best of our knowledge, the application of deep learning in the field of quantitative risk management is still a relatively recent phenomenon. In this article, we utilize techniques inspired by reinforcement learning in order to optimize the operation plans of underground natural gas storage facilities. We provide a theoretical framework and assess the performance of the proposed method numerically in comparison to a state of the art least squares Monte Carlo approach. Due to the inherent intricacy originating from the high dimensional forward market as well as the numerous constraints and frictions, the optimization exercise can hardly be tackled by means of traditional techniques.


Governance for Security, Risks, Competition and Cooperation Mapping the knowledge. The study aims to generate a map of the knowledge based on the research on topics related to governance and security, risks, competition and cooperation for the FDDI (Fudan Development Institute) proceedings publishing project 'Reflections on Governance Security and Risks, Competition and Cooperation.' That mapping exercise would enable a broader audience to delve into the current state, and interdisciplinary pathways of the research published worldwide for addressing complex problems of governance. Following this introduction, the second section presents the bibliometric methods used and the results' interpretation. The third section presents the results, followed by the fourth and fifth sections of discussion and conclusion, respectively.


Extending the GLS endomorphism to speed up GHS Weil descent using Magma. Let q 2 n , and let E mathbb F q ell be a generalized Galbraith Lin Scott (GLS) binary curve, with ell ge 2 and ( ell, n) 1 .We show that the GLS endomorphism on E mathbb F q ell induces an efficient endomorphism on the Jacobian J H( mathbb F q) of the genus g hyperelliptic curve H corresponding to the image of the GHS Weil descent attack applied to E mathbb F q ell , and that this endomorphism yields a factor n speedup when using standard index calculus procedures for solving the Discrete Logarithm Problem (DLP) on J H( mathbb F q) . Our analysis is backed up by the explicit computation of a discrete logarithm defined on a prime order subgroup of a GLS elliptic curve over the field mathbb F 2 5 cdot 31 . A Magma implementation of our algorithm finds the aforementioned discrete logarithm in about 1,035 CPU days.


An Improved BAT Algorithm for Solving Job Scheduling Problems in Hotels and Restaurants. One popular example of metaheuristic algorithms from the swarm intelligence family is the Bat algorithm (BA). The algorithm was first presented in 2010 by Yang and quickly demonstrated its efficiency in comparison with other common algorithms. The BA is based on echolocation in bats. The BA uses automatic zooming to strike a balance between exploration and exploitation by imitating the deviations of the bat's pulse emission rate and loudness as it searches for prey. The BA maintains solution diversity using the frequency tuning technique. In this way, the BA can quickly and efficiently switch from exploration to exploitation. Therefore, it becomes an efficient optimizer for any application when a quick solution is needed. In this paper, an improvement on the original BA has been made to speed up convergence and make the method more practical for large applications. To conduct a comprehensive comparative analysis between the original BA, the modified BA proposed in this paper, and other state of the art bio inspired metaheuristics, the performance of both approaches is evaluated on a standard set of 23 (unimodal, multimodal, and fixed dimension multimodal) benchmark functions. Afterward, the modified BA was applied to solve a real world job scheduling problem in hotels and restaurants. Based on the achieved performance metrics, the proposed MBA establishes better global search ability and convergence than the original BA and other approaches.


TCGL Temporal Contrastive Graph for Self supervised Video Representation Learning. Video self supervised learning is a challenging task, which requires significant expressive power from the model to leverage rich spatial temporal knowledge and generate effective supervisory signals from large amounts of unlabeled videos. However, existing methods fail to increase the temporal diversity of unlabeled videos and ignore elaborately modeling multi scale temporal dependencies in an explicit way. To overcome these limitations, we take advantage of the multi scale temporal dependencies within videos and proposes a novel video self supervised learning framework named Temporal Contrastive Graph Learning (TCGL), which jointly models the inter snippet and intra snippet temporal dependencies for temporal representation learning with a hybrid graph contrastive learning strategy. Specifically, a Spatial Temporal Knowledge Discovering (STKD) module is first introduced to extract motion enhanced spatial temporal representations from videos based on the frequency domain analysis of discrete cosine transform. To explicitly model multi scale temporal dependencies of unlabeled videos, our TCGL integrates the prior knowledge about the frame and snippet orders into graph structures, i.e., the intra inter snippet Temporal Contrastive Graphs (TCG). Then, specific contrastive learning modules are designed to maximize the agreement between nodes in different graph views. To generate supervisory signals for unlabeled videos, we introduce an Adaptive Snippet Order Prediction (ASOP) module which leverages the relational knowledge among video snippets to learn the global context representation and recalibrate the channel wise features adaptively. Experimental results demonstrate the superiority of our TCGL over the state of the art methods on large scale action recognition and video retrieval benchmarks.The code is publicly available at https github.com YangLiu9208 TCGL.